Auto Model Generating for DBT. Simple CLI for Unnesting Staging Data… | by Baysan | CodeX | Medium

I’ve been studying about microservices and Kubernetes for almost 2 weeks. Therefore, I couldn’t invert new things to write 🫠 Actually, I’ve implemented some new tech stacks into the projects I am working on. To make you excited for the future, I’d say that we’ll see how to implement OpenSearch our projects to create our own search services. 🥸 I work in a consultancy company that we develop an IT infra project for one of our customers. The customer’s data team needs to update the staging tables and data marts to improve their reports. To update the related tables, I need to check nested data structure (in JSON form) and update the added or removed columns in my dbt models. It wasn’t hurting me until a table appeared with almost 75 columns. 🤯 That time I coded a simple Python cli instead of the time probably I’d spend to convert 75 columns row by row. I’ve published the repo on our VCS with the slogan below. I created this script because I am too lazy to write row by row :& Our folder

I’ve been studying about microservices and Kubernetes for almost 2 weeks. Therefore, I couldn’t invert new things to write 🫠 Actually, I’ve implemented some new tech stacks into the projects I am working on. To make you excited for the future, I’d say that we’ll see how to implement OpenSearch our projects to create our own search services. 🥸 I work in a consultancy company that we develop an IT infra project for one of our customers. The customer’s data team needs to update the staging tables and data marts to improve their reports. To update the related tables, I need to check nested data