Ondisk merge consuming RAM · Issue #1262 · facebookresearch/faiss
I'm following the demo_ondisk_ivf.py demo to merge several indexes (partitions) into one. The total combined size of all partitions exceeds my RAM capacity. The documentation says this should be fine, but the RAM consumption keeps growing until the system crashes.
Ondisk merge consuming RAM · Issue #1262 · facebookresearch/faiss · GitHub Skip to content You signed in with another tab or window. Reload to refresh your session. You signed out in another tab or window. Reload to refresh your session. You switched accounts on another tab or window. Reload to refresh your session. Dismiss alert {{ message }} Uh oh! There was an error while loading. Please reload this page . facebookresearch / faiss Public Notifications You must be signed in to change notification settings Fork 4.5k Star 40.6k Ondisk merge consuming RAM #1262 New issue Copy link New issue Cop
related reading
- Indexes that do not fit in RAM · facebookresearch/faiss Wiki · GitHubgithub.com
- Faiss: A library for efficient similarity search - Engineering at Metaengineering.fb.com
- Does Faiss support searching from Disk? · Issue #876 · facebookresearch/faiss · GitHubgithub.com
- GitHub - facebookresearch/faiss: A library for efficient similarity search and clustering of dense vectors.github.com
- Indexing 1T vectors · facebookresearch/faiss Wiki · GitHubgithub.com
- Lower memory footprint · facebookresearch/faiss Wiki · GitHubgithub.com
- Regarding the IndexFlatIP · Issue #1119 · facebookresearch/faiss · GitHubgithub.com
- optimization - Memory usage keep growing while writing the Lucene.Net index - Stack Overflowstackoverflow.com
- GitHub - matsui528/faiss_tips: Some useful tips for faiss · GitHubgithub.com
- Guidelines to choose an index · facebookresearch/faiss Wiki · GitHubgithub.com
- Faiss indexes · facebookresearch/faiss Wiki · GitHubgithub.com
- Getting started · facebookresearch/faiss Wiki · GitHubgithub.com