✳flâneur — a map of the web's best reading

Scaling and Parallel Processing

docs.spring.io · 2,762 words · saved by 1 readers

Many batch processing problems can be solved with single threaded, single process jobs, so it is always a good idea to properly check if that meets your needs before thinking about more complex implementations. Measure the performance of a realistic job and see if the simplest implementation meets your needs first. You can read and write a file of several hundred megabytes in well under a minute, even with standard hardware. When you are ready to start implementing a job with some parallel processing, Spring Batch offers a range of options, which are described in this chapter, although some features are covered elsewhere. At a high level, there are two modes of parallel processing: Single process, multi-threaded Multi-process These break down into categories as well, as follows: Multi-threaded Step (single process) Parallel Steps (single process) Remote Chunking of Step (multi process) Partitioning a Step (single or multi process) First, we review the single-process options. Then we re

Scaling and Parallel Processing Table of Contents 1. Scaling and Parallel Processing 1.1. Multi-threaded Step 1.2. Parallel Steps 1.3. Remote Chunking 1.4. Partitioning 1.4.1. PartitionHandler 1.4.2. Partitioner 1.4.3. Binding Input Data to Steps 1. Scaling and Parallel Processing XML Java Both --> Many batch processing problems can be solved with single threaded, single process jobs, so it is always a good idea to properly check if that meets your needs before thinking about more complex implementations. Measure the performance of a realistic job and see if the simplest implementation meets y

Explore this link on the map →

related reading