Fast and Simple Image Search with Foundation Models — Ivan Zhou
In this blog post, I will guide you through the process of building an image search tool using multimodal foundation models. Traditional image search engines require significant engineering efforts to develop and are difficult to adapt to personal photos. In this project, we developed a fast and sim
Introduction In this blog post, I will walk you through how to build a fast and simple image search tool. Traditional image search engines require extensive engineering efforts to develop and are difficult to adapt to my own albums. In this project, my partner, Ran Li , and I developed an image search application that uses multimodal foundation models to search for highly accurate and relevant results. By following this blog post and our code base, you can easily build one yourself. This project was a side project that we did to explore large foundation models . Our code is publicly available
Explore this link on the map →saved by
related reading
- Think of language models like ChatGPT as a “calculator for words”simonwillison.net
- Faiss: A library for efficient similarity search - Engineering at Metaengineering.fb.com
- Patterns for Building LLM-based Systems & Productseugeneyan.com
- Replicate - Run AI with an APIreplicate.com
- 2403.09611.pdfarxiv.org
- AI Model & API Providers Analysis | Artificial Analysisartificialanalysis.ai
- Introducing text and code embeddings | OpenAIopenai.com
- Our AI Research: How We Evaluate Semantic Search Technology | Exa Blogexa.ai
- From grep to SPLADE: A Journey Through Semantic Search - Elicitblog.elicit.com
- ImageBind: Holistic AI learning across six modalitiesai.facebook.com
- Turing Bletchley: A Universal Image Language Representation model by Microsoft - Microsoft Researchmicrosoft.com
- Chroma Context-1: Training a Self-Editing Search Agent | Chromatrychroma.com