Skip to content

feat: add InstancePools to EndpointConfig ProductionVariants - #362

Open
michaelhtm wants to merge 1 commit into
aws-controllers-k8s:mainfrom
michaelhtm:feat/add-instancepools-to-productionvariant
Open

feat: add InstancePools to EndpointConfig ProductionVariants#362
michaelhtm wants to merge 1 commit into
aws-controllers-k8s:mainfrom
michaelhtm:feat/add-instancepools-to-productionvariant

Conversation

@michaelhtm

Copy link
Copy Markdown
Member

Description of changes:
Bumps the sagemaker SDK to v1.244.0 to expose the InstancePools field on
ProductionVariant, enabling heterogeneous endpoints that provision across a
prioritized list of instance types. The field maps automatically as a nested
field on the already-generated ProductionVariant shape; no hooks needed.

The SDK bump also introduces unrelated new resources and fields. To keep the
change scoped to InstancePools, new resources (AIBenchmarkJob,
AIRecommendationJob, AIWorkloadConfig, MlflowApp, PresignedMlflowAppUrl) are
added to ignore.resource_names, and new out-of-scope fields (MetricsConfig,
Specifications, ScaleInPolicy, DataCacheConfig, SchedulingConfig,
ModelPackageRegistrationType, AdditionalModelDataSources, BaseModel,
DatasetSource, MlflowConfig, ModelPackageConfig, ServerlessJobConfig,
VariantInstanceProvisionTimeoutInSeconds, MlflowExperimentName, and others)
are added to ignore.field_paths on both their input and output shapes.

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.

@ack-prow
ack-prow Bot requested review from a-hilaly and knottnt July 16, 2026 19:17
@ack-prow

ack-prow Bot commented Jul 16, 2026

Copy link
Copy Markdown

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: michaelhtm

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Details Needs approval from an approver in each of these files:

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

@ack-prow ack-prow Bot added the approved label Jul 16, 2026
@michaelhtm
michaelhtm force-pushed the feat/add-instancepools-to-productionvariant branch from 87e3894 to 1bfb4e4 Compare July 16, 2026 19:44
@michaelhtm

Copy link
Copy Markdown
Member Author

/label release/minor

@ack-prow ack-prow Bot added the release/minor Indicates this PR should trigger a minor version release on merge. label Jul 16, 2026
Bumps the sagemaker SDK to v1.244.0 to expose the InstancePools field on
ProductionVariant, enabling heterogeneous endpoints that provision across a
prioritized list of instance types. The field maps automatically as a nested
field on the already-generated ProductionVariant shape; no hooks needed.

The SDK bump also introduces unrelated new resources and fields. To keep the
change scoped to InstancePools, new resources (AIBenchmarkJob,
AIRecommendationJob, AIWorkloadConfig, MlflowApp, PresignedMlflowAppUrl) are
added to ignore.resource_names, and new out-of-scope fields (MetricsConfig,
Specifications, ScaleInPolicy, DataCacheConfig, SchedulingConfig,
ModelPackageRegistrationType, AdditionalModelDataSources, BaseModel,
DatasetSource, MlflowConfig, ModelPackageConfig, ServerlessJobConfig,
VariantInstanceProvisionTimeoutInSeconds, MlflowExperimentName, and others)
are added to ignore.field_paths on both their input and output shapes.
@michaelhtm
michaelhtm force-pushed the feat/add-instancepools-to-productionvariant branch from 1bfb4e4 to 991342f Compare July 23, 2026 17:05
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

approved release/minor Indicates this PR should trigger a minor version release on merge.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant