Introduction to streaming for data scientists
As machine learning moves towards real-time, streaming technology is becoming increasingly important for data scientists. Like many people coming from a mach...
As machine learning moves towards real-time , streaming technology is becoming increasingly important for data scientists. Like many people coming from a machine learning background, I used to dread streaming. In our recent survey, almost half of the data scientists we asked said they would like to move from batch prediction to online prediction but can’t because streaming is hard, both technically and operationally. Phrases that the streaming community take for granted like “time-variant results”, “time travel”, “materialized view” certainly don’t help. Over the last year, working with a co-f
related reading
- Real-time machine learning: challenges and solutionshuyenchip.com
- Machine learning is going real-timehuyenchip.com
- What Is Streaming Data? - Streaming Data Explained - AWSaws.amazon.com
- Streamlit • A faster way to build and share data appsstreamlit.io
- GlassFlow | ClickHouse Data Ingestion: CDC, Backfill & Schema Evolutionglassflow.dev
- Streaming ingestion to a materialized view - Amazon Redshiftdocs.aws.amazon.com
- S2, the durable stream APIs2.dev
- MosaicML StreamingDataset: Fast, Accurate Streaming of Training Data from Cloud Storage | Databricks Blogmosaicml.com
- What I Learned From The Modern Data Stack Conference 2021 - James Lejameskle.com
- The Distributed Computing Manifesto | All Things Distributedallthingsdistributed.com
- How to design resilient and large scale data systemsblog.dataengineer.io
- Mediummaximebeauchemin.medium.com