Building a RAG Pipeline for the Entire Python Ecosystem

This blog is a technical deep dive into Context, an open-source initiative from Fleet AI to embed the entire python ecosystem & give LLMs real-time knowledge of libraries. The world moves fast and libraries are updated all the time. While tools like ChatGPT and Github Copilot have achieved massive adoption amongst developers, their knowledge is incomplete and cutoff at the last training date. If you need help with the latest version of any recently updated library you are pretty much out of luck. Even ChatGPT fails when asked about its own API changes, giving a deprecated function "openai.ChatCompletion.create()" when asked how to call their endpoint in python. LLMs lack of real-time knowledge is also a pain for library maintainers. For the Pydantic team, version 2 of their library was released in June 2023, beyond the training cutoff for most LLMs. If you ask chatGPT about pydantic, it has no knowledge of the new changes. When speaking to the Langchain team, we found that most LLMs kn

This blog is a technical deep dive into Context, an open-source initiative from Fleet AI to embed the entire python ecosystem & give LLMs real-time knowledge of libraries. The world moves fast and libraries are updated all the time. While tools like ChatGPT and Github Copilot have achieved massive adoption amongst developers, their knowledge is incomplete and cutoff at the last training date. If you need help with the latest version of any recently updated library you are pretty much out of luck. Even ChatGPT fails when asked about its own API changes, giving a deprecated function "openai.Chat