feat: add S3 support to spark connect

[razvan]

Description

Fixes stackabletech/issues#809

✔️ Depends on the decision: https://github.com/stackabletech/decisions/issues/77

🟢 : CI https://testing.stackable.tech/view/02%20Operator%20Tests%20(custom)/job/spark-k8s-operator-it-custom/61/

Definition of Done Checklist

• Not all of these items are applicable to all PRs, the author should update this template to only leave the boxes in that are relevant
• Please make sure all these things are done and tick the boxes

Author

• Changes are OpenShift compatible
• CRD changes approved
• CRD documentation for all fields, following the style guide.
• Helm chart can be installed and deployed operator works
• Integration tests passed (for non trivial changes)
• Changes need to be "offline" compatible
• Links to generated (nightly) docs added
• Release note snippet added

Reviewer

• Code contains useful comments
• Code contains useful logging statements
• (Integration-)Test cases added
• Documentation added or updated. Follows the style guide.
• Changelog updated
• Cargo.toml only contains references to git tags (not specific commits or branches)

Acceptance

• Feature Tracker has been updated
• Proper release label has been added
• Links to generated (nightly) docs added
• Release note snippet added
• Add type/deprecation label & add to the deprecation schedule
• Add type/experimental label & add to the experimental features tracker

[maltesander]

Nice! Only minor things.

[maltesander]

LGTM!

[razvan]

Release Note

• This release adds first class support for S3 buckets and connections to Spark Connect servers. Users can give clients access to all S3 buckets or a selected list. For more details, see the xref:spark-k8s:usage-guide/spark-connect.adoc[Spark Connect usage guide].