Skip to content

Feat/zimmer v2 backport - #6153

Open
Rishabh0255 wants to merge 1 commit into
aws:master-v2from
Rishabh0255:feat/zimmer-v2-backport
Open

Feat/zimmer v2 backport#6153
Rishabh0255 wants to merge 1 commit into
aws:master-v2from
Rishabh0255:feat/zimmer-v2-backport

Conversation

@Rishabh0255

Copy link
Copy Markdown
Contributor

Summary

Backports the 8 Zimmer pipeline step classes from v3 (#6140) to v2.

  • SageMaker inference deployment: EndpointConfigStep, EndpointStep, InferenceComponentStep
  • Amazon Bedrock: BedrockCustomModelStep, BedrockCustomModelDeploymentStep, BedrockModelImportStep, BedrockProvisionedModelThroughputStep
  • Lineage tracking: LineageStep

Also adds 8 values to StepTypeEnum and mirrors the v3 test coverage.

Relationship to v3 PR

Same design, same API surface, same test structure as #6140 -- only difference is import paths (v2's single-package sagemaker.workflow.* layout vs v3's sagemaker.mlops.workflow.*).

Each step accepts an opaque arguments: Dict[str, Any] that is forwarded to the pipeline service verbatim, matching the existing SDK convention used by LambdaStep and CallbackStep. EndpointConfigStep supports retry_policies. EndpointConfigStep and EndpointStep support cache_config.

Testing

Unit tests (tests/unit/sagemaker/workflow/test_zimmer_steps.py, 24 tests): construction, to_request() shape, enum values, retry-policy rejection on non-retryable steps, Bedrock properties, LineageStep argument validation.

Integration test (tests/integ/sagemaker/workflow/test_zimmer_lineage_step.py): full end-to-end LineageStep pipeline execution, asserts Succeeded and verifies the created action ARN in step metadata.

Additional gamma validation (performed against v3, applies unchanged to v2 -- same wire format, same server-side deserializer contract):

  • Byte-for-byte JSON parity with the example pipelines from the Zimmer design doc
  • CreatePipeline + DescribePipeline round-trip for all 8 step types
  • Cross-step property references resolve correctly
  • End-to-end LineageStep pipeline executed to Succeeded on gamma

Compatibility

No changes to existing v2 step types, Pipeline, or the steps compiler beyond adding 8 values to StepTypeEnum.

Backports the 8 Zimmer pipeline step classes from v3 (PR aws#6140) to v2:

- EndpointConfigStep, EndpointStep (SageMaker inference deployment)
- InferenceComponentStep (multi-model endpoint support)
- BedrockCustomModelStep, BedrockCustomModelDeploymentStep,
  BedrockModelImportStep, BedrockProvisionedModelThroughputStep
- LineageStep (ML governance tracking)

Also adds 8 new values to StepTypeEnum.

Design: each step accepts an opaque 'arguments: Dict[str, Any]' that is
forwarded to the pipeline service verbatim, mirroring the existing SDK
convention used by LambdaStep and CallbackStep. Refer to the corresponding
AWS Create* API references for accepted fields.

Retryability per Zimmer step contract: only EndpointConfigStep is
retryable. Cacheability: EndpointConfigStep and EndpointStep are
structurally cacheable via cache_config.

sim: https://issues.amazon.com/issues/P424919850
---
X-AI-Prompt: Backport the Zimmer pipeline step types from the v3 PR
(aws#6140) to the v2 SDK on master-v2
X-AI-Tool: kiro-cli
@Rishabh0255
Rishabh0255 changed the base branch from master to master-v2 August 4, 2026 19:27
@Rishabh0255
Rishabh0255 requested a review from a team as a code owner August 4, 2026 19:27
@Rishabh0255
Rishabh0255 requested a review from jam-jee August 4, 2026 19:27
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant