flâneur

limitations of embeddings

bneo.xyz · 376 words · saved by 1 readers

writing daily

October 16, 2025 · 2 min read here's a scenario: you have a vector db of disease terms mapping to information you want, say journal_id, and given a user query, you want to find all the journal_ids for that disease term. say the disease term is "autoimmune polyendocrine syndrome type 1" and you use using text-embedding-ada-002 and got this back: 0.6462 │ Type 1 Diabetes Mellitus │ ID_001, ID_003 (+92 more) 0.6452 │ Type 1 Diabetes │ ID_002, ID_004 (+95 more) 0.6443 │ Autoimmune Polyendocrinopathy... │ ID_099 my first thought, being medically illiterate like me, is oh the model saw Type…

saved by

related reading