Ondisk merge consuming RAM · Issue #1262 · facebookresearch/faiss
I'm following the demo_ondisk_ivf.py demo to merge several indexes (partitions) into one. The total combined size of all partitions exceeds my RAM capacity. The documentation says this should be fine, but the RAM consumption keeps growing until the system crashes.
Ondisk merge consuming RAM · Issue #1262 · facebookresearch/faiss · GitHub Skip to content You signed in with another tab or window. Reload to refresh your session. You signed out in another tab or window. Reload to refresh your session. You switched accounts on another tab or window. Reload to refresh your session. Dismiss alert {{ message }} Uh oh! There was an error while loading. Please reload this page . facebookresearch / faiss Public Notifications You must be signed in to change notification settings Fork 4.5k Star 40.6k Ondisk merge consuming RAM #1262 New issue Copy link New issue Cop
Explore this link on the map →related reading
- Indexes that do not fit in RAM · facebookresearch/faiss Wiki · GitHubgithub.com
- GitHub - matsui528/faiss_tips: Some useful tips for faiss · GitHubgithub.com
- Faiss: A library for efficient similarity search - Engineering at Metaengineering.fb.com
- Lower memory footprint · facebookresearch/faiss Wiki · GitHubgithub.com
- Indexing 1T vectors · facebookresearch/faiss Wiki · GitHubgithub.com
- Notionnanransohoff.com
- Does Faiss support searching from Disk? · Issue #876 · facebookresearch/faiss · GitHubgithub.com
- Build Your Own Databasenan.fyi
- Guidelines to choose an index · facebookresearch/faiss Wiki · GitHubgithub.com
- GitHub - facebookresearch/faiss: A library for efficient similarity search and clustering of dense vectors. · GitHubgithub.com
- Product Quantization: Compressing high-dimensional vectors by 97% | Pineconepinecone.io
- Faiss indexes · facebookresearch/faiss Wiki · GitHubgithub.com