flâneur

nomic-ai/deepscatter: Zoomable, animated scatterplots in the browser that scales over a billion points

github.com · 1,128 words · saved by 1 readers

Zoomable, animated scatterplots in the browser that scales over a billion points

Deep Scatterplots for the Web This is a library for allowing interactive visualization of extremely large datasets, in browser. It's fast for three reasons: All data is sent in the Apache Arrow feather format, in a custom quadtree format that makes it possible to only load data as needed on zoom. Feather takes no time to parse in the browser once transferred, compresses pretty well, and can be directly copied to the GPU without transformation in JS. This is the way of the future. We also now allow custom in-browser calculations on Arrow data. Most rendering is done in custom layers using WebGL

related reading