Skip to content

chore: Bump data-designer and anonymizer library versions - #659

Merged
mikeknep merged 10 commits into
mainfrom
dd-anon-bump/mknepper
Jul 14, 2026
Merged

chore: Bump data-designer and anonymizer library versions#659
mikeknep merged 10 commits into
mainfrom
dd-anon-bump/mknepper

Conversation

@mikeknep

@mikeknep mikeknep commented Jul 13, 2026

Copy link
Copy Markdown
Contributor

As of DD 0.7.0, model configs require an explicit provider, and the model provider registry no longer recognizes/accepts/declares a default. Most of the deletions here are removing logic and tests related to the previous default behavior.

Summary by CodeRabbit

  • Documentation
    • Updated Data Designer references across guides, tutorials, and migration/next steps to v0.7.0.
  • New Features / API & Schema Updates
    • Updated OpenAPI generation to support a per-plugin allowlist setting.
    • Refreshed OpenAPI schemas (e.g., removed allow_resize from multiple column configs; clarified ModelConfig.provider wording).
  • Enhancements
    • Improved model-provider resolution when configs omit an explicit provider (including no-LLM and local-first cases).
  • Bug Fixes
    • Refined provider validation/error behavior for missing provider scenarios.
  • Tests
    • Updated test discovery and adjusted unit/integration coverage for the new provider behavior.

@mikeknep
mikeknep requested review from a team as code owners July 13, 2026 21:30
@github-actions github-actions Bot added the chore label Jul 13, 2026
@github-actions

Copy link
Copy Markdown
Contributor

@mikeknep
mikeknep requested a review from mckornfield July 13, 2026 21:32
@coderabbitai

coderabbitai Bot commented Jul 13, 2026

Copy link
Copy Markdown
Contributor

Review Change Stack

Note

Reviews paused

It looks like this branch is under active development. To avoid overwhelming you with review comments due to an influx of new commits, CodeRabbit has automatically paused this review. You can configure this behavior by changing the reviews.auto_review.auto_pause_after_reviewed_commits setting.

Use the following commands to manage reviews:

  • @coderabbitai resume to resume automatic reviews.
  • @coderabbitai review to trigger a single review.

Use the checkboxes below for quick actions:

  • ▶️ Resume reviews
  • 🔍 Trigger review
📝 Walkthrough

Walkthrough

Changes

Data Designer upgrade

Layer / File(s) Summary
Data Designer 0.7.0 adoption
packages/*/pyproject.toml, plugins/*/pyproject.toml, .github/wheel-constraints/*, docs/data-designer/...
Dependency pins and documentation links move from v0.6.1 to v0.7.0; the anonymizer requirement moves to v0.3.0.
Provider registry resolution
packages/data_designer_nemo/src/.../model_provider.py, plugins/*/tests/*
Registries no longer set explicit defaults, missing-provider validation is deferred, and test model configurations specify default/nvidia.
Scoped OpenAPI generation
script/generate_openapi_spec.py, script/openapi_helper/plugin_config.py, plugins/nemo-data-designer/pyproject.toml, tests/unit/test_plugin_openapi_config.py
Plugin configuration accepts validated Data Designer allowlists, and OpenAPI generation temporarily filters matching entry points.
Anonymizer schema contracts
plugins/nemo-data-designer/openapi/openapi.yaml
Removes allow_resize from column schemas and revises the ModelConfig.provider description.
Test and dependency metadata alignment
packages/data_designer_nemo/tests/*, pytest.ini, third_party/*
Filesystem tests use the injected SDK filesystem, pytest discovery changes, and generated dependency, vulnerability, license, and hash metadata is refreshed.

Possibly related PRs

Suggested labels: refactor

Suggested reviewers: crookedstorm, maxdubrinsky, svvarom

🚥 Pre-merge checks | ✅ 4 | ❌ 1

❌ Failed checks (1 warning)

Check name Status Explanation Resolution
Docstring Coverage ⚠️ Warning Docstring coverage is 0.00% which is insufficient. The required threshold is 80.00%. Write docstrings for the functions missing them to satisfy the coverage threshold.
✅ Passed checks (4 passed)
Check name Status Explanation
Description Check ✅ Passed Check skipped - CodeRabbit’s high-level summary is enabled.
Title check ✅ Passed The title clearly matches the main change: bumping data-designer and anonymizer versions.
Linked Issues check ✅ Passed Check skipped because no linked issues were found for this pull request.
Out of Scope Changes check ✅ Passed Check skipped because no linked issues were found for this pull request.
✨ Finishing Touches
🧪 Generate unit tests (beta)
  • Create PR with unit tests
  • Commit unit tests in branch dd-anon-bump/mknepper

Comment @coderabbitai help to get the list of available commands.

@coderabbitai coderabbitai Bot left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Actionable comments posted: 1

🧹 Nitpick comments (1)
plugins/nemo-data-designer/tests/unit/test_preview_function.py (1)

27-29: 📐 Maintainability & Code Quality | 🔵 Trivial | ⚡ Quick win

Update the obsolete provider-resolution bypass.

The fixture now includes provider="default/nvidia", but _patch_preview_dependencies() still describes it as provider-less and replaces model extraction with []. This hides the new provider-resolution path; either update the rationale and add separate coverage, or remove the bypass if resolution belongs in this test.

🤖 Prompt for AI Agents
Verify each finding against current code. Fix only still-valid issues, skip the
rest with a brief reason, keep changes minimal, and validate.

In `@plugins/nemo-data-designer/tests/unit/test_preview_function.py` around lines
27 - 29, Update _patch_preview_dependencies() to stop treating the fixture’s
ModelConfig as provider-less now that provider="default/nvidia" is set. Remove
the model-extraction bypass so the test exercises provider resolution, or revise
the rationale and add dedicated coverage that validates the new
provider-resolution path.
🤖 Prompt for all review comments with AI agents
Verify each finding against current code. Fix only still-valid issues, skip the
rest with a brief reason, keep changes minimal, and validate.

Inline comments:
In `@plugins/nemo-data-designer/pyproject.toml`:
- Line 50: Run refresh-data-designer-skill using the updated
data-designer==0.7.0 pins in plugins/nemo-data-designer/pyproject.toml,
regenerating third_party/requirements-main.txt so it removes the stale 0.6.1,
data-designer-config, and data-designer-engine entries. Apply the same generated
synchronization for packages/data_designer_nemo/pyproject.toml,
packages/nemo_platform/pyproject.toml at lines 90-90, 246-246, and 267-267,
plugins/nemo-anonymizer/pyproject.toml, and
plugins/nemo-data-designer/pyproject.toml at lines 10-10; do not edit generated
requirements by hand.

---

Nitpick comments:
In `@plugins/nemo-data-designer/tests/unit/test_preview_function.py`:
- Around line 27-29: Update _patch_preview_dependencies() to stop treating the
fixture’s ModelConfig as provider-less now that provider="default/nvidia" is
set. Remove the model-extraction bypass so the test exercises provider
resolution, or revise the rationale and add dedicated coverage that validates
the new provider-resolution path.
🪄 Autofix (Beta)

Fix all unresolved CodeRabbit comments on this PR:

  • Push a commit to this branch (recommended)
  • Create a new PR with the fixes

ℹ️ Review info
⚙️ Run configuration

Configuration used: Path: .coderabbit.yaml

Review profile: CHILL

Plan: Enterprise

Run ID: 6b257676-1062-4f74-96ad-f87b50c215b7

📥 Commits

Reviewing files that changed from the base of the PR and between 77d897e and 70f7dde.

⛔ Files ignored due to path filters (1)
  • uv.lock is excluded by !**/*.lock
📒 Files selected for processing (17)
  • docs/data-designer/index.mdx
  • docs/data-designer/migration.mdx
  • docs/data-designer/tutorials/basics.mdx
  • docs/data-designer/tutorials/index.mdx
  • docs/data-designer/tutorials/seeding.mdx
  • packages/data_designer_nemo/pyproject.toml
  • packages/data_designer_nemo/src/data_designer_nemo/model_provider.py
  • packages/data_designer_nemo/tests/unit/test_fileset_file_seed_reader.py
  • packages/data_designer_nemo/tests/unit/test_model_configs.py
  • packages/nemo_platform/pyproject.toml
  • plugins/nemo-anonymizer/pyproject.toml
  • plugins/nemo-data-designer/pyproject.toml
  • plugins/nemo-data-designer/tests/integration/test_remote_validation_errors.py
  • plugins/nemo-data-designer/tests/unit/test_model_provider.py
  • plugins/nemo-data-designer/tests/unit/test_preview_function.py
  • plugins/nemo-data-designer/tests/unit/test_sdk_resources.py
  • pytest.ini
💤 Files with no reviewable changes (2)
  • plugins/nemo-data-designer/tests/unit/test_model_provider.py
  • plugins/nemo-data-designer/tests/integration/test_remote_validation_errors.py

Comment thread plugins/nemo-data-designer/pyproject.toml
@github-actions

github-actions Bot commented Jul 13, 2026

Copy link
Copy Markdown
Contributor
Suite Lines Covered Line Rate Branch Rate
Unit Tests 23880/31011 77.0% 61.8%
Integration Tests 13810/29660 46.6% 19.6%

@mikeknep
mikeknep force-pushed the dd-anon-bump/mknepper branch from 70f7dde to a4b2205 Compare July 13, 2026 21:44
@mikeknep
mikeknep requested a review from a team as a code owner July 13, 2026 22:18

@coderabbitai coderabbitai Bot left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

🧹 Nitpick comments (1)
plugins/nemo-data-designer/openapi/openapi.yaml (1)

687-747: 📐 Maintainability & Code Quality | 🔵 Trivial | ⚡ Quick win

New anonymizer schemas lack docstrings.

ChunkedValidationConfig, DetectionTransformConfig, and DetectionTransformOperation have no description field, unlike every other column-config schema in this file (all have detailed Attributes docs). Since this is generated from Pydantic docstrings, add docstrings to the underlying model classes for consistency and better generated API docs.

Also applies to: 1212-1253

🤖 Prompt for AI Agents
Verify each finding against current code. Fix only still-valid issues, skip the
rest with a brief reason, keep changes minimal, and validate.

In `@plugins/nemo-data-designer/openapi/openapi.yaml` around lines 687 - 747, The
underlying Pydantic model classes for ChunkedValidationConfig,
DetectionTransformConfig, and DetectionTransformOperation lack documentation
docstrings. Add detailed class docstrings describing each model’s purpose and
attributes so schema generation emits a description field, matching the other
column-config models; do not edit the generated OpenAPI YAML directly.
🤖 Prompt for all review comments with AI agents
Verify each finding against current code. Fix only still-valid issues, skip the
rest with a brief reason, keep changes minimal, and validate.

Nitpick comments:
In `@plugins/nemo-data-designer/openapi/openapi.yaml`:
- Around line 687-747: The underlying Pydantic model classes for
ChunkedValidationConfig, DetectionTransformConfig, and
DetectionTransformOperation lack documentation docstrings. Add detailed class
docstrings describing each model’s purpose and attributes so schema generation
emits a description field, matching the other column-config models; do not edit
the generated OpenAPI YAML directly.

ℹ️ Review info
⚙️ Run configuration

Configuration used: Path: .coderabbit.yaml

Review profile: CHILL

Plan: Enterprise

Run ID: c7301990-e65c-4c27-aaff-8166a88d0260

📥 Commits

Reviewing files that changed from the base of the PR and between a4b2205 and 39ca3f7.

📒 Files selected for processing (4)
  • .github/wheel-constraints/nemo-platform-services.txt
  • plugins/nemo-data-designer/openapi/openapi.yaml
  • third_party/osv-licenses.json
  • third_party/requirements-main.txt

Comment thread docs/data-designer/index.mdx
Comment thread web/packages/sdk/generated/agents/schema/DeploymentLogsResponse.ts Outdated
@mikeknep
mikeknep force-pushed the dd-anon-bump/mknepper branch from 10bde1c to 5086851 Compare July 14, 2026 13:43
@coderabbitai

coderabbitai Bot commented Jul 14, 2026

Copy link
Copy Markdown
Contributor

Caution

Failed to replace (edit) comment. This is likely due to insufficient permissions or the comment being deleted.

Error details
putComment timed out

@coderabbitai coderabbitai Bot left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

🧹 Nitpick comments (1)
script/generate_openapi_spec.py (1)

328-357: 🎯 Functional Correctness | 🔵 Trivial | ⚡ Quick win

Test the global entry-point override.

Add coverage for filtering the target group, preserving other groups, and restoration after an exception.

🤖 Prompt for AI Agents
Verify each finding against current code. Fix only still-valid issues, skip the
rest with a brief reason, keep changes minimal, and validate.

In `@script/generate_openapi_spec.py` around lines 328 - 357, Add tests for
data_designer_plugin_allowlist covering filtering data_designer.plugins to only
allowed names, returning unrelated entry-point groups unchanged, and restoring
importlib.metadata.entry_points when the context exits through an exception.
🤖 Prompt for all review comments with AI agents
Verify each finding against current code. Fix only still-valid issues, skip the
rest with a brief reason, keep changes minimal, and validate.

Nitpick comments:
In `@script/generate_openapi_spec.py`:
- Around line 328-357: Add tests for data_designer_plugin_allowlist covering
filtering data_designer.plugins to only allowed names, returning unrelated
entry-point groups unchanged, and restoring importlib.metadata.entry_points when
the context exits through an exception.

ℹ️ Review info
⚙️ Run configuration

Configuration used: Path: .coderabbit.yaml

Review profile: CHILL

Plan: Enterprise

Run ID: 0353c99a-c172-41f8-864a-32110c843b1f

📥 Commits

Reviewing files that changed from the base of the PR and between 5086851 and 9d7e447.

📒 Files selected for processing (6)
  • plugins/nemo-anonymizer/tests/unit/test_run_job.py
  • plugins/nemo-data-designer/openapi/openapi.yaml
  • plugins/nemo-data-designer/pyproject.toml
  • script/generate_openapi_spec.py
  • script/openapi_helper/plugin_config.py
  • tests/unit/test_plugin_openapi_config.py
💤 Files with no reviewable changes (1)
  • plugins/nemo-data-designer/openapi/openapi.yaml
🚧 Files skipped from review as they are similar to previous changes (1)
  • plugins/nemo-data-designer/pyproject.toml

mikeknep added 10 commits July 14, 2026 09:55
Signed-off-by: Mike Knepper <mknepper@nvidia.com>
Signed-off-by: Mike Knepper <mknepper@nvidia.com>
Signed-off-by: Mike Knepper <mknepper@nvidia.com>
Signed-off-by: Mike Knepper <mknepper@nvidia.com>
Signed-off-by: Mike Knepper <mknepper@nvidia.com>
Signed-off-by: Mike Knepper <mknepper@nvidia.com>
Signed-off-by: Mike Knepper <mknepper@nvidia.com>
Signed-off-by: Mike Knepper <mknepper@nvidia.com>
Signed-off-by: Mike Knepper <mknepper@nvidia.com>
Signed-off-by: Mike Knepper <mknepper@nvidia.com>
@mikeknep
mikeknep force-pushed the dd-anon-bump/mknepper branch from 9d7e447 to ed6dd31 Compare July 14, 2026 14:56
@mikeknep
mikeknep enabled auto-merge July 14, 2026 15:01
@mikeknep
mikeknep added this pull request to the merge queue Jul 14, 2026
Merged via the queue into main with commit b62a72e Jul 14, 2026
57 checks passed
@mikeknep
mikeknep deleted the dd-anon-bump/mknepper branch July 14, 2026 15:42
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants