Jeremy Tee

3 followers · 3 following · 284 views

on the atlas · 32

highlights · 19

Listening is going to be your #1 asset when finding impact
How to propose an impactful improvement to the codebase and own the implementation
In cluster mode, the Spark driver runs inside an application master process which is managed by YARN on the cluster, and the client can go away after initiating the application. In client mode, the driver runs in the client process, and the application master is only used for requesting resources from YARN.
Running Spark on YARN - Spark 3.5.1 Documentation
I stopped blaming my manager and taking the driver seat to push my career forward.
Career Growth Speed, Deconstructed | by Carlos Arguelles | Geek Culture | Medium
They took a genuine interest in my growth, provided candid feedback on strengths and weaknesses, challenged me, and facilitated a fast track for me when I deserved it
Career Growth Speed, Deconstructed | by Carlos Arguelles | Geek Culture | Medium
The best senior engineers realize that their key role is not just individual contribution. It is empowering teams through technical vision and context to unlock autonomous passion towards collective goals.
The Making of a Senior Engineer 💡: Guest Post by Addy Osmani
meetings are a good forcing function
How To Drive Meetings - by Ryan Peterman
t's a framework, a philosophy that enables organizations to navigate the bustling metropolis of the Power Platform. It provides the means to manage resources, enforce governance and compliance, foster a community of learners, and manage an innovation backlog.
Power Platform #1: An Insight into the Center of Excellence (CoE) | LinkedIn
provides a clear vision and direction, ensuring that all Power Platform activities align with the organization's business goals. It promotes the efficient use of resources and accelerates the delivery of solutions. Moreover, it instills a culture of continuous learning and innovation, keeping the organization at the cutting edge of digital transformation
Power Platform #1: An Insight into the Center of Excellence (CoE) | LinkedIn
There are things we do because our mentors do it, who do it because their mentors did it, who did it to address issues that aren't as relevant anymore. If something sounds like a just-so story, it very well might be.
Advice for new software devs who've read all those other advice essays • Buttondown
The biggest obstacles to engineering productivity are not writing lines of code too slowly or not working long hours, they are: Working on the wrong thing Getting bogged down in arguments, or being endlessly indecisive Waiting on other teams to do their work, waiting on code review Ramping new engineers, or trying to support unfamiliar code When people are upset, distracted, or unmotivated Unfinished migrations, migrations in flight, or having to support multiple systems indefinitely When production systems are poorly understood and opaque, quality suffers, and firefighting skyrockets Terrible…
Why Should You (Or Anyone) Become An Engineering Manager? – charity.wtf
Data Engineering team doesn't create direct business value — but the value should come in making the Reporting and Analytics, and Data Science teams more productive and efficient to ensure delivery of maximum value to business stakeholders through Data & Analytics initiatives
Building a Data Engineering CoE by Richie Bachala | Towards Data Science
Make sure to take responsibility and ownership to help everyone else get better at it.
How to grow from senior to a lead role
It’s quite common for engineers to feel stuck in the position and not know which steps to take to grow toward a tech lead / team lead position
How to grow from senior to a lead role
VARBYTE does not currently support any decompression methods. Because of this, records containing compressed data can't be queried in Redshift. Decompress your data before pushing it into the Kinesis stream or Amazon MSK topic.
Streaming ingestion - Amazon Redshift
After creating a materialized view on your stream or topic, you can create another materialized view in order to join your streaming materialized view to other materialized views, tables, or views.
Streaming ingestion - Amazon Redshift
To create a schedule to run a SQL statement
Scheduling a query - Amazon Redshift
A feature is done only when it behaves as the PO expects it AND when a "release checklist" is finished. The "Release Checklist" can be a set of bullet points like "Is every function well documented", "Does every function have at least X unit tests", "Was the code reviewed by at least X developers".
Managing technical debt at an agile company
It's hard to explain why it matters to not cut corners, but nevertheless, we always need to have the business be aware of the costs. If you can quantify it, you can argue that this short-term gain of $$ will result in $$$ costs in the long run.
Managing technical debt at an agile company
Integration with Amazon MSK and Kinesis Data Streams
Amazon Kinesis Data Firehose Features - Streaming Data Pipeline - Amazon Web Services