Maximum parallelism expansion can be used in MAXIMIZE_UTILISATION mode.

[low-bee]

What is the purpose of the change

This pull request adds a new feature to Maximum parallelism expansion can be used in MAXIMIZE_UTILISATION mode.

Brief change log

(for example:)
Add parameters to maintain consistent behavior

Verifying this change

(Please pick either of the following options)

This change is a trivial rework / code cleanup without any test coverage.

(or)

This change is already covered by existing tests, such as (please describe tests).

(or)

This change added tests and can be verified as follows:

(example:)

• Added integration tests for end-to-end deployment with large payloads (100MB)
• Extended integration test for recovery after master (JobManager) failure
• Manually verified the change by running a 4 node cluster with 2 JobManagers and 4 TaskManagers, a stateful streaming program, and killing one JobManager and two TaskManagers during the execution, verifying that recovery happens correctly.

Does this pull request potentially affect one of the following parts:

• Dependencies (does it add or upgrade a dependency): (no)
• The public API, i.e., is any changes to the CustomResourceDescriptors: (no)
• Core observer or reconciler logic that is regularly executed: (no)

Documentation

• Does this pull request introduce a new feature? (yes)
• If yes, how is the feature documented? (not documented)

[gyfora]

Please create / link to a JIRA ticket and add test coverage for the change

[davidradl]

could we have unit tests for this please