Merge pull request hortonworks#11772 from hortonworks/dbialek2-patch-1

Update the DL backup policy

CB-14232 - support exact threshold, percentage base threshold and best

Detail: https://jira.cloudera.com/browse/CB-14232

CB-14811. Create kafka/kudu connectors

details:
- add new modules: streaming-common, kudu-connector, kafka-connector
- streaming-common contains an abstract processor that sends data to processing queue(s) in order to handle by a worker (record by record)
- in order to not block other operations, create blocking queue + worker pairs, for processing data is put into blocking queue and the worker runs on a different thread, it uses the grpc client for processing
- multiple workers (+ clients) can be used based on application configs (means more threads), also queues has a limit in order to not grow memoery too high if the communication would not work and hanging for some reason
- any new streaming processor can be added with providing a new implementation of AbstractRecordProcessor + using a new custom streaming configurations
- added unit tests
- add new abstract processor implementations: kafka and kudu
- in case of specific usages, extends the abstract kafka or kudu processors -> create a spring bean from them + make sure the packages are scanned by spring

Merge pull request hortonworks#11766 from hortonworks/CB-13177

[CB-13177] missing resource identifier for GCP LB

CB-14540 Base distrox OS upgrade L0 test

CB-14839 suites_log and integcb/logs should be compress to save space…

… on jenkins and have longer te4st result retention time

CB-14558 Datalake deletion stuck, force delete does not work

For any call to `stackService.getByCrn` where subsequent code can handle the case that the returned
datalake is 'null', replace that call with `stackService.getByCrnOrElseNull`. This will eliminate
the errors deleting a datahub when the attached datalake cannot be found.

Tested with unit tests and by manually create a DL+DH, then removing the DL CRN from the database so
it could not be found. Verified the DH, DL, and env could all be successfully deleted.

CB-14768 Fix OptimisticLockException during the default Cluster defin…

…itions update

CB-13472 - Validate for stopped/unreachable FreeIPA

This commit
 - introduces FreeIPA validation during recovery() and validateRecoverable() calls on CB side
 - refactors FreeIPA validation on SDX side

CB-14482 Set the callingServiceName GRPC context for UMS calls