The Other Side of the Screen
Lately I've been doing a lot (millions) of calculations involving small NumPy arrays of HST PSFs. Naturally, I wanted to save the output of these calculations to for later analysis. I put all the results in a MySQL database so I could easily select subsets of the data for future work (by filter, image, date, etc.). However, sometimes the outputs of these calculations are arrays themselves. This left me searching for a good way to save these NumPy arrays to a SQL database.
Working with NumPy Arrays and SQL Lately I've been doing a lot (millions) of calculations involving small NumPy arrays of HST PSFs. Naturally, I wanted to save the output of these calculations to for later analysis. I put all the results in a MySQL database so I could easily select subsets of the data for future work (by filter, image, date, etc.). However, sometimes the outputs of these calculations are arrays themselves. This left me searching for a good way to save these NumPy arrays to a SQL database. Before I dive into this it's worth noting that there are non-SQL storage options that are
related reading
- python - Numpy Array to SQL Table - Stack Overflowstackoverflow.com
- python - What's the most efficient way to convert a MySQL result set to a NumPy array? - Stack Overflowstackoverflow.com
- Python's Array: Working With Numeric Data Efficiently – Real Pythonrealpython.com
- Python: Just write SQLjoaodlf.com
- A Recipe for Training Neural Networkskarpathy.github.io
- Starting out with Numpy, Pandas, Scikit-Learn, and Kerasblog.sdan.net
- Analyzing and Visualizing Data: OxRSE Trainingtrain.oxrse.uk
- GPT in 60 Lines of NumPy | Jay Modyjaykmody.com
- Building data-centric apps with a reactive relational databaseriffle.systems
- A Recipe for Training Neural Networkskarpathy.github.io
- Build Your Own Databasenan.fyi
- Using PyTorch + NumPy? You're making a mistake. · Tanel Pärnamaatanelp.github.io