flâneur

Running a Batch job using AWS Batch and Docker Image | by Siva Chandan C | Medium

sivachandanc.medium.com · 649 words · saved by 1 readers

As a Data Engineer, you encounter two fundamental processes when dealing with data.

Running a Batch job using AWS Batch and Docker Image Siva Chandan C 3 min read · May 2, 2023 -- 1 Listen Share As a Data Engineer, you encounter two fundamental processes when dealing with data. Batch Processing Streaming (real-time) What is a Batch Job and how is this different from streaming? The main difference between batch processing and stream processing is the way data is processed. In batch processing, data is processed in discrete chunks or batches at specific intervals, usually offline. The data is collected over a period of time, and then processed all at once in a batch. Batch proc

related reading