platformcomponents

Run Component Configuration Jobs in Parallel

There's a new option to run component configuration jobs in parallel.

Cover Image for Run Component Configuration Jobs in Parallel

All components (usually data source and data destination components) that support configuration rows now have the option to set job parallelism at the configuration level.

This means that you can control the speed of an extraction or writing process and which scenarios you want to speed up a bit.

This setting is optional, and Parallel jobs: Off is the default option.

Imagine you have five rows in your configuration. Setting the parallelism to 2 means the five jobs will be processed as three sets of consecutive jobs (2 + 2 + 1) . The jobs in each set will run in parallel.

This feature is now available in all projects with Queue v2 and on all stacks.