Skip to content
Draft
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
6 changes: 3 additions & 3 deletions .github/workflows/push.yml
Original file line number Diff line number Diff line change
Expand Up @@ -422,7 +422,7 @@ jobs:
# Use Checks API (not Statuses API) to match the required "Integration Tests" check.
- name: Skip integration tests (pull request)
if: ${{ github.event_name == 'pull_request' && !contains(fromJSON(needs.testmask.outputs.targets), 'test') && !contains(fromJSON(needs.testmask.outputs.targets), 'test-exp-ssh') }}
uses: actions/github-script@v8
uses: actions/github-script@ed597411d8f924073f98dfc5c65a23a2325f34cd # v8.0.0
with:
github-token: ${{ steps.generate-check-token.outputs.token }}
script: |
Expand All @@ -443,7 +443,7 @@ jobs:
# Use Checks API (not Statuses API) to match the required "Integration Tests" check.
- name: Auto-approve for merge group
if: ${{ github.event_name == 'merge_group' }}
uses: actions/github-script@v8
uses: actions/github-script@ed597411d8f924073f98dfc5c65a23a2325f34cd # v8.0.0
with:
github-token: ${{ steps.generate-check-token.outputs.token }}
script: |
Expand Down Expand Up @@ -487,7 +487,7 @@ jobs:

steps:
- name: Skip integration tests
uses: actions/github-script@v8
uses: actions/github-script@ed597411d8f924073f98dfc5c65a23a2325f34cd # v8.0.0
with:
script: |-
await github.rest.checks.create({
Expand Down
4 changes: 2 additions & 2 deletions .github/workflows/release.yml
Original file line number Diff line number Diff line change
Expand Up @@ -115,7 +115,7 @@ jobs:
AZURE_CLIENT_SECRET: ${{ secrets.DECO_SIGN_AZURE_CLIENT_SECRET }}

- name: Upload Windows artifacts to GitHub Actions
uses: actions/upload-artifact@v7
uses: actions/upload-artifact@bbbca2ddaa5d8feaa63e36b76fdaad77386f024f # v7.0.0
with:
name: windows-artifacts
path: |
Expand All @@ -135,7 +135,7 @@ jobs:

steps:
- name: Download Windows artifacts
uses: actions/download-artifact@v8
uses: actions/download-artifact@3e5f45b2cfb9172054b4087a40e8e0b5a5461e7c # v8.0.1
with:
name: windows-artifacts
path: dist
Expand Down
4 changes: 2 additions & 2 deletions .github/workflows/tagging.yml
Original file line number Diff line number Diff line change
Expand Up @@ -34,13 +34,13 @@ jobs:
steps:
- name: Generate GitHub App Token
id: generate-token
uses: actions/create-github-app-token@v3
uses: actions/create-github-app-token@f8d387b68d61c58ab83c6c016672934102569859 # v3.0.0
with:
app-id: ${{ secrets.DECO_SDK_TAGGING_APP_ID }}
private-key: ${{ secrets.DECO_SDK_TAGGING_PRIVATE_KEY }}

- name: Checkout repository
uses: actions/checkout@v6.0.2
uses: actions/checkout@de0fac2e4500dabe0009e67214ff5f5447ce83dd # v6.0.2
with:
fetch-depth: 0
token: ${{ steps.generate-token.outputs.token }}
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -56,8 +56,8 @@ The following resources will be deleted:
delete resources.jobs.job2
delete resources.pipelines.pipeline1

This action will result in the deletion of the following Lakeflow Spark Declarative Pipelines along with the
Streaming Tables (STs) and Materialized Views (MVs) managed by them:

This action will result in the deletion or recreation of the following Lakeflow Spark Declarative Pipelines along with the Streaming Tables (STs) and Materialized Views (MVs) managed by them:
delete resources.pipelines.pipeline1

All files and directories at the following location will be deleted: /Workspace/Users/[USERNAME]/.bundle/test-bundle-[UNIQUE_NAME]/default
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -39,8 +39,8 @@ The following resources will be deleted:
delete resources.jobs.my_job
delete resources.pipelines.my_pipeline

This action will result in the deletion of the following Lakeflow Spark Declarative Pipelines along with the
Streaming Tables (STs) and Materialized Views (MVs) managed by them:

This action will result in the deletion or recreation of the following Lakeflow Spark Declarative Pipelines along with the Streaming Tables (STs) and Materialized Views (MVs) managed by them:
delete resources.pipelines.my_pipeline

All files and directories at the following location will be deleted: /Workspace/Users/[USERNAME]/.bundle/test-bundle-[UNIQUE_NAME]/default
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -57,10 +57,14 @@ The following resources will be deleted:
delete resources.sql_warehouses.test_warehouse
delete resources.volumes.test_volume

This action will result in the deletion of the following volumes.
For managed volumes, the files stored in the volume are also deleted from your
cloud tenant within 30 days. For external volumes, the metadata about the volume
is removed from the catalog, but the underlying files are not deleted:

This action will result in the deletion or recreation of the following MLflow experiments along with all their runs, metrics, and artifacts:
delete resources.experiments.test_experiment

This action will result in the deletion or recreation of the following registered models along with all their versions:
delete resources.registered_models.test_model

This action will result in the deletion or recreation of the following volumes. For managed volumes, the files stored in the volume are also deleted from your cloud tenant within 30 days. For external volumes, the metadata about the volume is removed from the catalog, but the underlying files are not deleted:
delete resources.volumes.test_volume

All files and directories at the following location will be deleted: /Workspace/Users/[USERNAME]/.bundle/test-bundle-[UNIQUE_NAME]/default
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -55,8 +55,8 @@ Resource: resources.pipelines.my_pipeline
The following resources will be deleted:
delete resources.pipelines.my_pipeline

This action will result in the deletion of the following Lakeflow Spark Declarative Pipelines along with the
Streaming Tables (STs) and Materialized Views (MVs) managed by them:

This action will result in the deletion or recreation of the following Lakeflow Spark Declarative Pipelines along with the Streaming Tables (STs) and Materialized Views (MVs) managed by them:
delete resources.pipelines.my_pipeline

All files and directories at the following location will be deleted: /Workspace/Users/[USERNAME]/.bundle/test-bundle-[UNIQUE_NAME]/default
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -50,8 +50,8 @@ The following resources will be deleted:
delete resources.jobs.my_job
delete resources.pipelines.my_pipeline

This action will result in the deletion of the following Lakeflow Spark Declarative Pipelines along with the
Streaming Tables (STs) and Materialized Views (MVs) managed by them:

This action will result in the deletion or recreation of the following Lakeflow Spark Declarative Pipelines along with the Streaming Tables (STs) and Materialized Views (MVs) managed by them:
delete resources.pipelines.my_pipeline

All files and directories at the following location will be deleted: /Workspace/Users/[USERNAME]/.bundle/test-bundle-[UNIQUE_NAME]/default
Expand Down
8 changes: 4 additions & 4 deletions acceptance/bundle/deploy/snapshot-comparison/output.txt
Original file line number Diff line number Diff line change
Expand Up @@ -44,8 +44,8 @@ The following resources will be deleted:
delete resources.jobs.test_job
delete resources.pipelines.test_pipeline

This action will result in the deletion of the following Lakeflow Spark Declarative Pipelines along with the
Streaming Tables (STs) and Materialized Views (MVs) managed by them:

This action will result in the deletion or recreation of the following Lakeflow Spark Declarative Pipelines along with the Streaming Tables (STs) and Materialized Views (MVs) managed by them:
delete resources.pipelines.test_pipeline

All files and directories at the following location will be deleted: /Workspace/Users/[USERNAME]/.bundle/snapshot-test-1-[UNIQUE_NAME]/default
Expand All @@ -59,8 +59,8 @@ The following resources will be deleted:
delete resources.jobs.test_job
delete resources.pipelines.test_pipeline

This action will result in the deletion of the following Lakeflow Spark Declarative Pipelines along with the
Streaming Tables (STs) and Materialized Views (MVs) managed by them:

This action will result in the deletion or recreation of the following Lakeflow Spark Declarative Pipelines along with the Streaming Tables (STs) and Materialized Views (MVs) managed by them:
delete resources.pipelines.test_pipeline

All files and directories at the following location will be deleted: /Workspace/Users/[USERNAME]/.bundle/snapshot-test-2-[UNIQUE_NAME]/default
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -15,8 +15,7 @@ Plan: 1 to add, 0 to change, 1 to delete, 0 unchanged
>>> errcode [CLI] bundle deploy
Uploading bundle files to /Workspace/Users/[USERNAME]/.bundle/test-bundle-[UNIQUE_NAME]/default/files...

This action will result in the deletion or recreation of the following dashboards.
This will result in changed IDs and permanent URLs of the dashboards that will be recreated:
This action will result in the deletion or recreation of the following dashboards. Recreated dashboards will have new IDs and permanent URLs:
recreate resources.dashboards.dashboard1
Error: the deployment requires destructive actions, but current console does not support prompting. Please specify --auto-approve if you would like to skip prompts and proceed

Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -11,21 +11,15 @@ Plan: 1 to add, 0 to change, 1 to delete, 0 unchanged
>>> musterr [CLI] bundle deploy
Uploading bundle files to /Workspace/Users/[USERNAME]/.bundle/test-pipeline-recreate-[UNIQUE_NAME]/default/files...

This action will result in the deletion or recreation of the following Lakeflow Spark Declarative Pipelines along with the
Streaming Tables (STs) and Materialized Views (MVs) managed by them. Recreating the pipelines will
restore the defined STs and MVs through full refresh. Note that recreation is necessary when pipeline
properties such as the 'catalog' or 'storage' are changed:
This action will result in the deletion or recreation of the following Lakeflow Spark Declarative Pipelines along with the Streaming Tables (STs) and Materialized Views (MVs) managed by them:
recreate resources.pipelines.foo
Error: the deployment requires destructive actions, but current console does not support prompting. Please specify --auto-approve if you would like to skip prompts and proceed


>>> [CLI] bundle deploy --auto-approve
Uploading bundle files to /Workspace/Users/[USERNAME]/.bundle/test-pipeline-recreate-[UNIQUE_NAME]/default/files...

This action will result in the deletion or recreation of the following Lakeflow Spark Declarative Pipelines along with the
Streaming Tables (STs) and Materialized Views (MVs) managed by them. Recreating the pipelines will
restore the defined STs and MVs through full refresh. Note that recreation is necessary when pipeline
properties such as the 'catalog' or 'storage' are changed:
This action will result in the deletion or recreation of the following Lakeflow Spark Declarative Pipelines along with the Streaming Tables (STs) and Materialized Views (MVs) managed by them:
recreate resources.pipelines.foo
Deploying resources...
Updating deployment state...
Expand Down
Original file line number Diff line number Diff line change
@@ -0,0 +1,9 @@

>>> [CLI] bundle deploy --auto-approve
Uploading bundle files to /Workspace/Users/[USERNAME]/.bundle/bind-secret-scope-test-[UNIQUE_NAME]/default/files...

This action will result in the deletion or recreation of the following secret scopes. All secrets stored in them will be permanently lost:
recreate resources.secret_scopes.secret_scope1
Deploying resources...
Updating deployment state...
Deployment complete!
Original file line number Diff line number Diff line change
@@ -0,0 +1,6 @@

>>> [CLI] bundle deploy --auto-approve
Uploading bundle files to /Workspace/Users/[USERNAME]/.bundle/bind-secret-scope-test-[UNIQUE_NAME]/default/files...
Deploying resources...
Updating deployment state...
Deployment complete!
6 changes: 0 additions & 6 deletions acceptance/bundle/deployment/bind/secret-scope/output.txt
Original file line number Diff line number Diff line change
Expand Up @@ -6,12 +6,6 @@ Updating deployment state...
Successfully bound secret_scope with an id 'test-secret-scope-[UNIQUE_NAME]'
Run 'bundle deploy' to deploy changes to your workspace

>>> [CLI] bundle deploy
Uploading bundle files to /Workspace/Users/[USERNAME]/.bundle/bind-secret-scope-test-[UNIQUE_NAME]/default/files...
Deploying resources...
Updating deployment state...
Deployment complete!

>>> [CLI] secrets list-scopes -o json
{
"backend_type": "DATABRICKS",
Expand Down
2 changes: 1 addition & 1 deletion acceptance/bundle/deployment/bind/secret-scope/script
Original file line number Diff line number Diff line change
Expand Up @@ -12,7 +12,7 @@ trap cleanup EXIT

trace $CLI bundle deployment bind secret_scope1 "${SECRET_SCOPE_NAME}" --auto-approve

trace $CLI bundle deploy
trace $CLI bundle deploy --auto-approve &> out.deploy.$DATABRICKS_BUNDLE_ENGINE.txt

trace $CLI secrets list-scopes -o json | jq --arg value ${SECRET_SCOPE_NAME} '.[] | select(.name == $value)'

Expand Down
3 changes: 2 additions & 1 deletion acceptance/bundle/deployment/unbind/grants/output.txt
Original file line number Diff line number Diff line change
Expand Up @@ -37,7 +37,8 @@ Deployment complete!
The following resources will be deleted:
delete resources.schemas.schema_1

This action will result in the deletion of the following UC schemas. Any underlying data may be lost:

This action will result in the deletion or recreation of the following UC schemas along with all the tables and views they contain:
delete resources.schemas.schema_1

All files and directories at the following location will be deleted: /Workspace/Users/[USERNAME]/.bundle/[UNIQUE_NAME]
Expand Down
8 changes: 4 additions & 4 deletions acceptance/bundle/destroy/all-resources/output.txt
Original file line number Diff line number Diff line change
Expand Up @@ -10,13 +10,13 @@ The following resources will be deleted:
delete resources.pipelines.my_pipeline
delete resources.schemas.my_schema

This action will result in the deletion of the following UC schemas. Any underlying data may be lost:
delete resources.schemas.my_schema

This action will result in the deletion of the following Lakeflow Spark Declarative Pipelines along with the
Streaming Tables (STs) and Materialized Views (MVs) managed by them:
This action will result in the deletion or recreation of the following Lakeflow Spark Declarative Pipelines along with the Streaming Tables (STs) and Materialized Views (MVs) managed by them:
delete resources.pipelines.my_pipeline

This action will result in the deletion or recreation of the following UC schemas along with all the tables and views they contain:
delete resources.schemas.my_schema

All files and directories at the following location will be deleted: /Workspace/Users/[USERNAME]/.bundle/test-bundle/default

Deleting files...
Expand Down
22 changes: 8 additions & 14 deletions acceptance/bundle/lifecycle/prevent-destroy/out.direct.txt
Original file line number Diff line number Diff line change
Expand Up @@ -35,14 +35,11 @@ Plan: 2 to add, 0 to change, 2 to delete, 0 unchanged
>>> [CLI] bundle deploy --auto-approve
Uploading bundle files to /Workspace/Users/[USERNAME]/.bundle/prevent-destroy/default/files...

This action will result in the deletion or recreation of the following UC schemas. Any underlying data may be lost:
recreate resources.schemas.my_schema

This action will result in the deletion or recreation of the following Lakeflow Spark Declarative Pipelines along with the
Streaming Tables (STs) and Materialized Views (MVs) managed by them. Recreating the pipelines will
restore the defined STs and MVs through full refresh. Note that recreation is necessary when pipeline
properties such as the 'catalog' or 'storage' are changed:
This action will result in the deletion or recreation of the following Lakeflow Spark Declarative Pipelines along with the Streaming Tables (STs) and Materialized Views (MVs) managed by them:
recreate resources.pipelines.my_pipelines

This action will result in the deletion or recreation of the following UC schemas along with all the tables and views they contain:
recreate resources.schemas.my_schema
Deploying resources...
Updating deployment state...
Deployment complete!
Expand All @@ -56,14 +53,11 @@ Plan: 0 to add, 0 to change, 2 to delete, 0 unchanged
>>> [CLI] bundle deploy --auto-approve
Uploading bundle files to /Workspace/Users/[USERNAME]/.bundle/prevent-destroy/default/files...

This action will result in the deletion or recreation of the following UC schemas. Any underlying data may be lost:
delete resources.schemas.my_schema

This action will result in the deletion or recreation of the following Lakeflow Spark Declarative Pipelines along with the
Streaming Tables (STs) and Materialized Views (MVs) managed by them. Recreating the pipelines will
restore the defined STs and MVs through full refresh. Note that recreation is necessary when pipeline
properties such as the 'catalog' or 'storage' are changed:
This action will result in the deletion or recreation of the following Lakeflow Spark Declarative Pipelines along with the Streaming Tables (STs) and Materialized Views (MVs) managed by them:
delete resources.pipelines.my_pipelines

This action will result in the deletion or recreation of the following UC schemas along with all the tables and views they contain:
delete resources.schemas.my_schema
Deploying resources...
Updating deployment state...
Deployment complete!
22 changes: 8 additions & 14 deletions acceptance/bundle/lifecycle/prevent-destroy/out.terraform.txt
Original file line number Diff line number Diff line change
Expand Up @@ -119,14 +119,11 @@ Plan: 2 to add, 0 to change, 2 to delete, 0 unchanged
>>> [CLI] bundle deploy --auto-approve
Uploading bundle files to /Workspace/Users/[USERNAME]/.bundle/prevent-destroy/default/files...

This action will result in the deletion or recreation of the following UC schemas. Any underlying data may be lost:
recreate resources.schemas.my_schema

This action will result in the deletion or recreation of the following Lakeflow Spark Declarative Pipelines along with the
Streaming Tables (STs) and Materialized Views (MVs) managed by them. Recreating the pipelines will
restore the defined STs and MVs through full refresh. Note that recreation is necessary when pipeline
properties such as the 'catalog' or 'storage' are changed:
This action will result in the deletion or recreation of the following Lakeflow Spark Declarative Pipelines along with the Streaming Tables (STs) and Materialized Views (MVs) managed by them:
recreate resources.pipelines.my_pipelines

This action will result in the deletion or recreation of the following UC schemas along with all the tables and views they contain:
recreate resources.schemas.my_schema
Deploying resources...
Updating deployment state...
Deployment complete!
Expand All @@ -140,14 +137,11 @@ Plan: 0 to add, 0 to change, 2 to delete, 0 unchanged
>>> [CLI] bundle deploy --auto-approve
Uploading bundle files to /Workspace/Users/[USERNAME]/.bundle/prevent-destroy/default/files...

This action will result in the deletion or recreation of the following UC schemas. Any underlying data may be lost:
delete resources.schemas.my_schema

This action will result in the deletion or recreation of the following Lakeflow Spark Declarative Pipelines along with the
Streaming Tables (STs) and Materialized Views (MVs) managed by them. Recreating the pipelines will
restore the defined STs and MVs through full refresh. Note that recreation is necessary when pipeline
properties such as the 'catalog' or 'storage' are changed:
This action will result in the deletion or recreation of the following Lakeflow Spark Declarative Pipelines along with the Streaming Tables (STs) and Materialized Views (MVs) managed by them:
delete resources.pipelines.my_pipelines

This action will result in the deletion or recreation of the following UC schemas along with all the tables and views they contain:
delete resources.schemas.my_schema
Deploying resources...
Updating deployment state...
Deployment complete!
4 changes: 2 additions & 2 deletions acceptance/bundle/migrate/runas/output.txt
Original file line number Diff line number Diff line change
Expand Up @@ -151,8 +151,8 @@ See https://docs.databricks.com/dev-tools/bundles/permissions.html to learn more
The following resources will be deleted:
delete resources.pipelines.foo

This action will result in the deletion of the following Lakeflow Spark Declarative Pipelines along with the
Streaming Tables (STs) and Materialized Views (MVs) managed by them:

This action will result in the deletion or recreation of the following Lakeflow Spark Declarative Pipelines along with the Streaming Tables (STs) and Materialized Views (MVs) managed by them:
delete resources.pipelines.foo

All files and directories at the following location will be deleted: /Workspace/Users/[USERNAME]/.bundle/dabs_revenue-[UNIQUE_NAME]/production
Expand Down
Loading
Loading