Use of the --jobs option or backup streams and the effect on NetBackup jobs and throttling options
The --jobs option for the gpbackup command line specifies the number of coordinator-initiated jobs that run in parallel. This setting translates to the number of worker processes that the coordinator runs concurrently. These processes send backup_data requests to each segment host and segment.
More information is available in the gpbackup utility reference guide.
The following list describes the interaction of the jobs option (gpbackup) and number_of_streams option (nbgpbackup_config.yaml):
The number_of_streams in the
nbgpbackup_config.yamlcontrols how many NetBackup jobs are created. Each NetBackup job that is created represents multiple files that are written to one image.The
number_of_streamsdetermines the number of NetBackup jobs that are created.
Segment hosts | Segments per host | Streams | Typical coordinator files | Total NetBackup jobs |
|---|---|---|---|---|
3 | 4 | 4 | 5 | 17 |
10 | 8 | 8 | 5 | 85 |