The Other Side of the Screen
Lately I've been doing a lot (millions) of calculations involving small NumPy arrays of HST PSFs. Naturally, I wanted to save the output of these calculations to for later analysis. I put all the results in a MySQL database so I could easily select subsets of the data for future work (by filter, image, date, etc.). However, sometimes the outputs of these calculations are arrays themselves. This left me searching for a good way to save these NumPy arrays to a SQL database.
Working with NumPy Arrays and SQL Lately I've been doing a lot (millions) of calculations involving small NumPy arrays of HST PSFs. Naturally, I wanted to save the output of these calculations to for later analysis. I put all the results in a MySQL database so I could easily select subsets of the data for future work (by filter, image, date, etc.). However, sometimes the outputs of these calculations are arrays themselves. This left me searching for a good way to save these NumPy arrays to a SQL database. Before I dive into this it's worth noting that there are non-SQL storage options that are
Explore this link on the map →related reading
- python - Numpy Array to SQL Table - Stack Overflowstackoverflow.com
- python - What's the most efficient way to convert a MySQL result set to a NumPy array? - Stack Overflowstackoverflow.com
- Against SQLscattered-thoughts.net
- Python's Array: Working With Numeric Data Efficiently – Real Pythonrealpython.com
- Python: Just write SQLjoaodlf.com
- Databases in 2024: A Year in Review // Blog // Andy Pavlo - Carnegie Mellon Universitycs.cmu.edu
- A More Human Approach To Databasesccorcos.github.io
- Using MongoDB with Pandas, NumPy, and PyArrow Data Engineeringanalyticsvidhya.com
- SQL vs NoSQL in 8 Examples | Towards Data Sciencetowardsdatascience.com
- Here is the reason why SQLAlchemy is so popular. | Towards Data Sciencetowardsdatascience.com
- SQL style guide by Simon Holywellsqlstyle.guide
- It's not you, it's SQLstack.convex.dev