Fast and Simple Image Search with Foundation Models — Ivan Zhou
In this blog post, I will guide you through the process of building an image search tool using multimodal foundation models. Traditional image search engines require significant engineering efforts to develop and are difficult to adapt to personal photos. In this project, we developed a fast and sim
Introduction In this blog post, I will walk you through how to build a fast and simple image search tool. Traditional image search engines require extensive engineering efforts to develop and are difficult to adapt to my own albums. In this project, my partner, Ran Li , and I developed an image search application that uses multimodal foundation models to search for highly accurate and relevant results. By following this blog post and our code base, you can easily build one yourself. This project was a side project that we did to explore large foundation models . Our code is publicly available
saved by
related reading
- Faiss: A library for efficient similarity search - Engineering at Metaengineering.fb.com
- Replicate - Run AI with an APIreplicate.com
- Patterns for Building LLM-based Systems & Productseugeneyan.com
- CLIP · Hugging Facehuggingface.co
- 2403.09611.pdfarxiv.org
- 1505.07647arxiv.org
- [2301.13823] Grounding Language Models to Images for Multimodal Generationarxiv.org
- ImageBind: Holistic AI learning across six modalitiesai.facebook.com
- Embeddings: What they are and why they mattersimonwillison.net
- Introducing text and code embeddings | OpenAIopenai.com
- Our AI Research: How We Evaluate Semantic Search Technology | Exa Blogexa.ai
- Announcing ScaNN: Efficient Vector Similarity Searchai.googleblog.com