Powering Feature Stores with ClickHouse
In this article, we dive into the world of MLOps and explore Feature Stores: the different types, why you may need one, and the main components. Considering this, we present how ClickHouse can be used to power a feature store and, thus, the model lifecycle, providing performance and flexibility. This blog is mostly introductory on the topic and designed to act as a precursor to subsequent examples of training ML models using features residing in ClickHouse. As evidence of the potential here, we do present our recent integration with Featureform - an open-source “virtual” feature store, which we will use for future examples. Before addressing what a feature store is, it might be helpful to clarify what a feature is. Put simply, a feature is some property of an entity that has predictive power for a Machine Learning (ML) model. An entity, in this sense, is a collection of features as well as a class or label representing a real-world concept. The features should, if of sufficient quality
Introduction # In this article, we dive into the world of MLOps and explore Feature Stores: the different types, why you may need one, and the main components. Considering this, we present how ClickHouse can be used to power a feature store and, thus, the model lifecycle, providing performance and flexibility. This blog is mostly introductory on the topic and designed to act as a precursor to subsequent examples of training ML models using features residing in ClickHouse. As evidence of the potential here, we do present our recent integration with Featureform - an open-source “virtual” feature
related reading
- Real-time machine learning: challenges and solutionshuyenchip.com
- Transformer Math 101 | EleutherAI Blogblog.eleuther.ai
- LLM Inference Performance Engineering: Best Practices | Databricks Blogdatabricks.com
- A Call to Build Models Like We Build Open-Source Softwarecolinraffel.com
- Non_Interactive – Software & MLnonint.com
- The Beginner's Guide to Databasestechnically.substack.com
- Enable Computer Vision on a Lakehouse | Databricks Blogdatabricks.com
- 2108.05053arxiv.org
- GlassFlow | ClickHouse Data Ingestion: CDC, Backfill & Schema Evolutionglassflow.dev
- In-depth: ClickHouse vs Snowflake - PostHogposthog.com
- Two Sizes Fit Most: PostgreSQL and ClickHouse - The New Stackthenewstack.io
- Components of an Open Source AI Compute Tech Stackanyscale.com