Emma Wu
0 followers · 268 views
on the atlas · 3
- The PARA Method: A Universal System for Organizing Digital Information - Forte Labs3 savers
- Data Engineers of Netflix — Interview with Pallavi Phadnis | by Netflix Technology Blog | Netflix TechBlog1 savers
- Evolution of ML Fact Store. by Vivek Kaushal | by Netflix Technology Blog | Netflix TechBlog1 savers
highlights · 9
improve data availability and usability for our consumers significantly.
Data Engineers of Netflix — Interview with Pallavi Phadnis | by Netflix Technology Blog | Netflix TechBlogbackend software engineer, designing and building the backend systems that enable big data analytics. I developed many batch and real-time data pipelines using open source technologies for AOL Advertising and eBay. I also built online serving systems and microservices powering Walmart’s e-commerce.
Data Engineers of Netflix — Interview with Pallavi Phadnis | by Netflix Technology Blog | Netflix TechBlogETL is the component where we experiment for query performance, improving data quality, and storage optimization
Evolution of ML Fact Store. by Vivek Kaushal | by Netflix Technology Blog | Netflix TechBlogany ETL changes could directly impact the query performance
Evolution of ML Fact Store. by Vivek Kaushal | by Netflix Technology Blog | Netflix TechBlogThis temporal accuracy of features is key to removing the training-serving skew.
Evolution of ML Fact Store. by Vivek Kaushal | by Netflix Technology Blog | Netflix TechBlogTemporal accuracy, in this context, is the ability to regenerate the exact set of features that were generated for the recommendations.
Evolution of ML Fact Store. by Vivek Kaushal | by Netflix Technology Blog | Netflix TechBlogthe offline feature generator uses these logged facts to regenerate temporally accurate features
Evolution of ML Fact Store. by Vivek Kaushal | by Netflix Technology Blog | Netflix TechBlogAn alternative to feature logging is to regenerate the features with updated feature encoders. If we can access the historical facts, we can regenerate the features using updated feature encoders.
Evolution of ML Fact Store. by Vivek Kaushal | by Netflix Technology Blog | Netflix TechBlogAxion — our fact store that is leveraged to compute ML features offline
Evolution of ML Fact Store. by Vivek Kaushal | by Netflix Technology Blog | Netflix TechBlog