Powering Feature Stores with ClickHouse
In this article, we dive into the world of MLOps and explore Feature Stores: the different types, why you may need one, and the main components. Considering this, we present how ClickHouse can be used to power a feature store and, thus, the model lifecycle, providing performance and flexibility. This blog is mostly introductory on the topic and designed to act as a precursor to subsequent examples of training ML models using features residing in ClickHouse. As evidence of the potential here, we do present our recent integration with Featureform - an open-source “virtual” feature store, which we will use for future examples. Before addressing what a feature store is, it might be helpful to clarify what a feature is. Put simply, a feature is some property of an entity that has predictive power for a Machine Learning (ML) model. An entity, in this sense, is a collection of features as well as a class or label representing a real-world concept. The features should, if of sufficient quality
Introduction # In this article, we dive into the world of MLOps and explore Feature Stores: the different types, why you may need one, and the main components. Considering this, we present how ClickHouse can be used to power a feature store and, thus, the model lifecycle, providing performance and flexibility. This blog is mostly introductory on the topic and designed to act as a precursor to subsequent examples of training ML models using features residing in ClickHouse. As evidence of the potential here, we do present our recent integration with Featureform - an open-source “virtual” feature
Explore this link on the map →related reading
- Real-time machine learning: challenges and solutionshuyenchip.com
- Evolution of ML Fact Store. by Vivek Kaushal | by Netflix Technology Blog | Netflix TechBlognetflixtechblog.com
- GlassFlow | ClickHouse Data Ingestion: CDC, Backfill & Schema Evolutionglassflow.dev
- Two Sizes Fit Most: PostgreSQL and ClickHouse - The New Stackthenewstack.io
- Introducing Husky, Datadog’s third-generation event store | Datadogdatadoghq.com
- In-depth: ClickHouse vs Snowflake - PostHogposthog.com
- ClickHouse - Wikipediaen.wikipedia.org
- Mediumtech.instacart.com
- What I Learned From The Modern Data Stack Conference 2021 - James Lejameskle.com
- MAI-Thinking-1: Building a Hill-Climbing Machinemicrosoft.ai
- ClickHouse vs. Elasticsearch: The Mechanics of Count Aggregations | ClickHouseclickhouse.com
- Introduction to streaming for data scientistshuyenchip.com