Skip to content

Infer SageMaker AMIs for CUDA 13 custom images - #270

Merged
shchur merged 4 commits into
masterfrom
auto-infer-sagemaker-ami
Sep 18, 2026
Merged

shchur merged 4 commits into
masterfrom
auto-infer-sagemaker-ami

Conversation

@shchur

@shchur shchur commented Sep 18, 2026 •

Copy link
Copy Markdown
Collaborator

Summary

  • infer SageMaker host AMI versions for custom image tags containing a hyphen-delimited cu13* component
  • use al2023-ami-sagemaker-inference-gpu-4-1 for real-time GPU endpoints
  • inject al2-ami-sagemaker-batch-gpu-535 for Batch Transform on G4dn, G5, and G6
  • preserve explicit user overrides and leave CPU, local, and unrecognized images unchanged
  • raise SDK dependency floors to versions that expose the required API fields

This keeps the public workflow unchanged:

predictor.fit(custom_image_uri=image_uri, ...)
predictor.deploy(custom_image_uri=image_uri, ...)
predictor.predict(custom_image_uri=image_uri, ...)

Validation

  • uv run --no-project pytest -q tests/unittests/general/test_sagemaker_ami.py tests/unittests/general/test_inference_modes.py tests/unittests/general/test_foundation_model.py
  • uv run --no-project ruff check src tests/unittests/general/test_sagemaker_ami.py tests/unittests/general/test_inference_modes.py
  • uv run --no-project ruff format --check src tests/unittests/general/test_sagemaker_ami.py tests/unittests/general/test_inference_modes.py
  • uv pip check

The billable SageMaker integration suite has not been run as part of this PR yet. The PR is left in draft for validation against the pre-release AutoGluon 1.6 images.

@shchur
shchur marked this pull request as ready for review September 18, 2026 12:16
@shchur
shchur enabled auto-merge (squash) September 18, 2026 12:23
@shchur
shchur disabled auto-merge September 18, 2026 12:23
@shchur
shchur enabled auto-merge (squash) September 18, 2026 12:23
@shchur
shchur merged commit 6efae22 into master Sep 18, 2026
9 checks passed
@github-actions

Copy link
Copy Markdown

Job PR-270-4a23111 is done.
Docs are uploaded to https://d12sc05jpx1wj5.cloudfront.net/PR-270/4a23111/index.html

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant