From 502a61bb54008e42c64a3f4238376661b6b20a4e Mon Sep 17 00:00:00 2001 From: Shreyas Goenka Date: Thu, 21 May 2026 12:46:26 +0000 Subject: [PATCH 1/7] Bump databricks-sdk-go to v0.136.0 MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 8bit ## Why Pulls in four releases of the Go SDK (v0.133 through v0.136). The headline addition is the new `bundle` service package, which exposes the Deployment Metadata Service (DMS) APIs (Deployments, Versions, Resources, Operations, Locks) used by the CLI's upcoming server-managed state work. Several other workspace-level service additions also surface as new CLI subcommands. ## Changes **Before:** CLI pinned `databricks-sdk-go` at `v0.132.0` and OpenAPI spec at SHA `a499dda0`. **Now:** Pinned at `v0.136.0` / OpenAPI SHA `0555d6a5`. Most of the diff is regenerated output from `./task generate` (CLI command stubs, JSON schema, bundle docs, Python bindings, acceptance goldens). Notable in this batch: - New `cmd/workspace/bundle/` — the auto-generated `databricks bundle` workspace commands fronting the DMS service (CreateDeployment, CreateVersion, CreateResource, CreateOperation, Heartbeat, CompleteVersion, etc.). The interface is marked as `Deprecated` in the SDK; this is a generator artifact, not a real deprecation. - New / refreshed pydabs models for new SDK types (`pipelines.Transformer*`, `pipelines.JsonTransformerOptions`, `pipelines.KafkaOptions`, `jobs.PythonOperatorTask*`). Hand-written changes: - **`CurrentUser.Me` signature:** v0.136 changed it from `Me(ctx)` to `Me(ctx, iam.MeRequest{})`. Updated 14 production callsites (`cmd/auth`, `cmd/apps`, `cmd/psql`, `cmd/sync`, `bundle/config/mutator`, `libs/template`, `libs/sync`, `libs/databrickscfg/cfgpickers`, `experimental/postgres`, `experimental/ssh/internal/{client,keys,workspace}`, `integration/internal/acc`, `acceptance/internal/prepare_server.go`, `acceptance/dbr_test.go`), 3 mocked test expectations in `cmd/auth/describe_test.go` (`Me(mock.Anything)` -> `Me(mock.Anything, mock.Anything)`). `bundle/direct/dresources/{apitypes,resources}.generated.yml` are unchanged from main: the field-behavior annotations they depend on come from the published OpenAPI CDN, which this branch could not be regenerated from in the build environment. The pre-bump versions already cover the new fields (`apps.App.url`, `apps.App.thumbnail_url`), so no manual edits to `resources.yml` were needed. ## Test plan - [x] `go build ./...` - [x] `go vet ./...` - [x] `go test ./internal/build ./bundle/internal/schema ./bundle/direct/dresources ./bundle/config/resources ./libs/template ./bundle/config/mutator` - [x] `TestConsistentDatabricksSdkVersion` confirms SDK version and OpenAPI SHA match - [x] Pydabs codegen tests (8 passed, run via `uv run --offline`) - [ ] CI on this PR Co-authored-by: Isaac --- .codegen/_openapi_sha | 2 +- .gitattributes | 1 + .github/workflows/tagging.yml | 0 NEXT_CHANGELOG.md | 4 + acceptance/bundle/refschema/out.fields.txt | 3213 ----------------- acceptance/bundle/refschema/output.txt | 65 +- acceptance/dbr_test.go | 7 +- acceptance/internal/prepare_server.go | 2 +- .../config/mutator/populate_current_user.go | 2 +- bundle/docsgen/output/reference.md | 334 +- bundle/docsgen/output/resources.md | 902 ++++- .../internal/schema/annotations_openapi.yml | 215 +- .../schema/annotations_openapi_overrides.yml | 14 + .../validation/generated/enum_fields.go | 84 +- bundle/schema/jsonschema.json | 276 +- bundle/schema/jsonschema_for_docs.json | 315 +- cmd/account/endpoints/endpoints.go | 40 +- cmd/account/iam-v2/iam-v2.go | 443 +++ cmd/account/settings-v2/settings-v2.go | 4 + cmd/apps/import.go | 3 +- cmd/apps/run_local.go | 3 +- cmd/auth/describe.go | 3 +- cmd/auth/describe_test.go | 6 +- cmd/auth/profiles.go | 3 +- cmd/psql/psql_autoscaling.go | 3 +- cmd/psql/psql_provisioned.go | 3 +- cmd/sync/completion.go | 3 +- cmd/workspace/bundle/bundle.go | 1108 ++++++ cmd/workspace/cmd.go | 2 + .../consumer-listings/consumer-listings.go | 2 +- cmd/workspace/current-user/current-user.go | 17 +- cmd/workspace/environments/environments.go | 14 +- cmd/workspace/experiments/experiments.go | 2 + .../feature-engineering.go | 21 +- cmd/workspace/groups.go | 4 + cmd/workspace/jobs/jobs.go | 1 + cmd/workspace/postgres/postgres.go | 127 +- .../supervisor-agents/supervisor-agents.go | 22 +- .../temporary-path-credentials.go | 10 +- .../temporary-volume-credentials.go | 25 +- .../vector-search-endpoints.go | 22 +- .../vector-search-indexes.go | 12 +- .../workspace-iam-v2/workspace-iam-v2.go | 409 +++ .../workspace-settings-v2.go | 4 + experimental/postgres/cmd/targeting.go | 5 +- experimental/ssh/internal/client/client.go | 3 +- experimental/ssh/internal/keys/secrets.go | 3 +- .../ssh/internal/workspace/workspace.go | 3 +- go.mod | 2 +- go.sum | 4 +- integration/bundle/init_test.go | 3 +- integration/cmd/auth/describe_test.go | 3 +- integration/cmd/sync/sync_test.go | 7 +- integration/internal/acc/fixtures.go | 5 +- internal/genkit/tagging.py | 99 +- internal/genkit/tagging.py.lock | 24 +- libs/databrickscfg/cfgpickers/clusters.go | 2 +- libs/sync/path.go | 2 +- libs/template/helpers.go | 6 +- .../bundles/catalogs/_models/privilege.py | 4 + python/databricks/bundles/jobs/__init__.py | 16 + .../jobs/_models/data_security_mode.py | 13 +- .../bundles/jobs/_models/environment.py | 10 +- .../bundles/jobs/_models/pipeline_params.py | 46 +- .../bundles/jobs/_models/pipeline_task.py | 50 +- .../jobs/_models/python_operator_task.py | 60 + .../_models/python_operator_task_parameter.py | 40 + .../databricks/bundles/jobs/_models/task.py | 22 +- .../databricks/bundles/pipelines/__init__.py | 30 + .../pipelines/_models/connector_options.py | 14 + .../file_ingestion_options_file_format.py | 5 +- ..._drive_options_google_drive_entity_type.py | 6 +- .../_models/json_transformer_options.py | 88 + .../pipelines/_models/kafka_options.py | 130 + .../bundles/pipelines/_models/pipeline.py | 5 +- ...arepoint_options_sharepoint_entity_type.py | 11 +- .../bundles/pipelines/_models/transformer.py | 54 + .../pipelines/_models/transformer_format.py | 18 + .../bundles/schemas/_models/privilege.py | 4 + .../bundles/volumes/_models/privilege.py | 4 + 80 files changed, 4948 insertions(+), 3605 deletions(-) mode change 100644 => 100755 .github/workflows/tagging.yml create mode 100755 cmd/workspace/bundle/bundle.go mode change 100644 => 100755 internal/genkit/tagging.py create mode 100644 python/databricks/bundles/jobs/_models/python_operator_task.py create mode 100644 python/databricks/bundles/jobs/_models/python_operator_task_parameter.py create mode 100644 python/databricks/bundles/pipelines/_models/json_transformer_options.py create mode 100644 python/databricks/bundles/pipelines/_models/kafka_options.py create mode 100644 python/databricks/bundles/pipelines/_models/transformer.py create mode 100644 python/databricks/bundles/pipelines/_models/transformer_format.py diff --git a/.codegen/_openapi_sha b/.codegen/_openapi_sha index 6e816b0ebb8..0373270428a 100644 --- a/.codegen/_openapi_sha +++ b/.codegen/_openapi_sha @@ -1 +1 @@ -a499dda0f7802e37868d3f3076f62639165475d8 \ No newline at end of file +0555d6a59265799ed8ea12f355eee662e739430d \ No newline at end of file diff --git a/.gitattributes b/.gitattributes index 44638c51278..595b0dba8c2 100644 --- a/.gitattributes +++ b/.gitattributes @@ -54,6 +54,7 @@ cmd/workspace/apps-settings/apps-settings.go linguist-generated=true cmd/workspace/apps/apps.go linguist-generated=true cmd/workspace/artifact-allowlists/artifact-allowlists.go linguist-generated=true cmd/workspace/automatic-cluster-update/automatic-cluster-update.go linguist-generated=true +cmd/workspace/bundle/bundle.go linguist-generated=true cmd/workspace/catalogs/catalogs.go linguist-generated=true cmd/workspace/clean-room-asset-revisions/clean-room-asset-revisions.go linguist-generated=true cmd/workspace/clean-room-assets/clean-room-assets.go linguist-generated=true diff --git a/.github/workflows/tagging.yml b/.github/workflows/tagging.yml old mode 100644 new mode 100755 diff --git a/NEXT_CHANGELOG.md b/NEXT_CHANGELOG.md index abc781fc6c1..263be74a8db 100644 --- a/NEXT_CHANGELOG.md +++ b/NEXT_CHANGELOG.md @@ -7,3 +7,7 @@ ### CLI ### Bundles + +### Dependency updates + +* Bump `github.com/databricks/databricks-sdk-go` from v0.132.0 to v0.136.0. diff --git a/acceptance/bundle/refschema/out.fields.txt b/acceptance/bundle/refschema/out.fields.txt index 42a2026c5eb..e69de29bb2d 100644 --- a/acceptance/bundle/refschema/out.fields.txt +++ b/acceptance/bundle/refschema/out.fields.txt @@ -1,3213 +0,0 @@ -resources.alerts.*.create_time string ALL -resources.alerts.*.custom_description string ALL -resources.alerts.*.custom_summary string ALL -resources.alerts.*.display_name string ALL -resources.alerts.*.effective_run_as *sql.AlertV2RunAs ALL -resources.alerts.*.effective_run_as.service_principal_name string ALL -resources.alerts.*.effective_run_as.user_name string ALL -resources.alerts.*.evaluation sql.AlertV2Evaluation ALL -resources.alerts.*.evaluation.comparison_operator sql.ComparisonOperator ALL -resources.alerts.*.evaluation.empty_result_state sql.AlertEvaluationState ALL -resources.alerts.*.evaluation.last_evaluated_at string ALL -resources.alerts.*.evaluation.notification *sql.AlertV2Notification ALL -resources.alerts.*.evaluation.notification.notify_on_ok bool ALL -resources.alerts.*.evaluation.notification.retrigger_seconds int ALL -resources.alerts.*.evaluation.notification.subscriptions []sql.AlertV2Subscription ALL -resources.alerts.*.evaluation.notification.subscriptions[*] sql.AlertV2Subscription ALL -resources.alerts.*.evaluation.notification.subscriptions[*].destination_id string ALL -resources.alerts.*.evaluation.notification.subscriptions[*].user_email string ALL -resources.alerts.*.evaluation.source sql.AlertV2OperandColumn ALL -resources.alerts.*.evaluation.source.aggregation sql.Aggregation ALL -resources.alerts.*.evaluation.source.display string ALL -resources.alerts.*.evaluation.source.name string ALL -resources.alerts.*.evaluation.state sql.AlertEvaluationState ALL -resources.alerts.*.evaluation.threshold *sql.AlertV2Operand ALL -resources.alerts.*.evaluation.threshold.column *sql.AlertV2OperandColumn ALL -resources.alerts.*.evaluation.threshold.column.aggregation sql.Aggregation ALL -resources.alerts.*.evaluation.threshold.column.display string ALL -resources.alerts.*.evaluation.threshold.column.name string ALL -resources.alerts.*.evaluation.threshold.value *sql.AlertV2OperandValue ALL -resources.alerts.*.evaluation.threshold.value.bool_value bool ALL -resources.alerts.*.evaluation.threshold.value.double_value float64 ALL -resources.alerts.*.evaluation.threshold.value.string_value string ALL -resources.alerts.*.file_path string INPUT -resources.alerts.*.id string ALL -resources.alerts.*.lifecycle resources.Lifecycle INPUT -resources.alerts.*.lifecycle.prevent_destroy bool INPUT -resources.alerts.*.lifecycle_state sql.AlertLifecycleState ALL -resources.alerts.*.modified_status string INPUT -resources.alerts.*.owner_user_name string ALL -resources.alerts.*.parent_path string ALL -resources.alerts.*.query_text string ALL -resources.alerts.*.run_as *sql.AlertV2RunAs ALL -resources.alerts.*.run_as.service_principal_name string ALL -resources.alerts.*.run_as.user_name string ALL -resources.alerts.*.run_as_user_name string ALL -resources.alerts.*.schedule sql.CronSchedule ALL -resources.alerts.*.schedule.pause_status sql.SchedulePauseStatus ALL -resources.alerts.*.schedule.quartz_cron_schedule string ALL -resources.alerts.*.schedule.timezone_id string ALL -resources.alerts.*.update_time string ALL -resources.alerts.*.url string INPUT -resources.alerts.*.warehouse_id string ALL -resources.alerts.*.permissions.object_id string ALL -resources.alerts.*.permissions[*] dresources.StatePermission ALL -resources.alerts.*.permissions[*].group_name string ALL -resources.alerts.*.permissions[*].level iam.PermissionLevel ALL -resources.alerts.*.permissions[*].service_principal_name string ALL -resources.alerts.*.permissions[*].user_name string ALL -resources.apps.*.active_deployment *apps.AppDeployment ALL -resources.apps.*.active_deployment.command []string ALL -resources.apps.*.active_deployment.command[*] string ALL -resources.apps.*.active_deployment.create_time string ALL -resources.apps.*.active_deployment.creator string ALL -resources.apps.*.active_deployment.deployment_artifacts *apps.AppDeploymentArtifacts ALL -resources.apps.*.active_deployment.deployment_artifacts.source_code_path string ALL -resources.apps.*.active_deployment.deployment_id string ALL -resources.apps.*.active_deployment.env_vars []apps.EnvVar ALL -resources.apps.*.active_deployment.env_vars[*] apps.EnvVar ALL -resources.apps.*.active_deployment.env_vars[*].name string ALL -resources.apps.*.active_deployment.env_vars[*].value string ALL -resources.apps.*.active_deployment.env_vars[*].value_from string ALL -resources.apps.*.active_deployment.git_source *apps.GitSource ALL -resources.apps.*.active_deployment.git_source.branch string ALL -resources.apps.*.active_deployment.git_source.commit string ALL -resources.apps.*.active_deployment.git_source.git_repository *apps.GitRepository ALL -resources.apps.*.active_deployment.git_source.git_repository.provider string ALL -resources.apps.*.active_deployment.git_source.git_repository.url string ALL -resources.apps.*.active_deployment.git_source.resolved_commit string ALL -resources.apps.*.active_deployment.git_source.source_code_path string ALL -resources.apps.*.active_deployment.git_source.tag string ALL -resources.apps.*.active_deployment.mode apps.AppDeploymentMode ALL -resources.apps.*.active_deployment.source_code_path string ALL -resources.apps.*.active_deployment.status *apps.AppDeploymentStatus ALL -resources.apps.*.active_deployment.status.message string ALL -resources.apps.*.active_deployment.status.state apps.AppDeploymentState ALL -resources.apps.*.active_deployment.update_time string ALL -resources.apps.*.app_status *apps.ApplicationStatus ALL -resources.apps.*.app_status.message string ALL -resources.apps.*.app_status.state apps.ApplicationState ALL -resources.apps.*.budget_policy_id string ALL -resources.apps.*.compute_size apps.ComputeSize ALL -resources.apps.*.compute_status *apps.ComputeStatus ALL -resources.apps.*.compute_status.active_instances int ALL -resources.apps.*.compute_status.message string ALL -resources.apps.*.compute_status.state apps.ComputeState ALL -resources.apps.*.config *resources.AppConfig ALL -resources.apps.*.config.command []string ALL -resources.apps.*.config.command[*] string ALL -resources.apps.*.config.env []resources.AppEnvVar ALL -resources.apps.*.config.env[*] resources.AppEnvVar ALL -resources.apps.*.config.env[*].name string ALL -resources.apps.*.config.env[*].value string ALL -resources.apps.*.config.env[*].value_from string ALL -resources.apps.*.create_time string ALL -resources.apps.*.creator string ALL -resources.apps.*.default_source_code_path string ALL -resources.apps.*.description string ALL -resources.apps.*.effective_budget_policy_id string ALL -resources.apps.*.effective_usage_policy_id string ALL -resources.apps.*.effective_user_api_scopes []string ALL -resources.apps.*.effective_user_api_scopes[*] string ALL -resources.apps.*.git_repository *apps.GitRepository ALL -resources.apps.*.git_repository.provider string ALL -resources.apps.*.git_repository.url string ALL -resources.apps.*.git_source *apps.GitSource ALL -resources.apps.*.git_source.branch string ALL -resources.apps.*.git_source.commit string ALL -resources.apps.*.git_source.git_repository *apps.GitRepository ALL -resources.apps.*.git_source.git_repository.provider string ALL -resources.apps.*.git_source.git_repository.url string ALL -resources.apps.*.git_source.resolved_commit string ALL -resources.apps.*.git_source.source_code_path string ALL -resources.apps.*.git_source.tag string ALL -resources.apps.*.id string ALL -resources.apps.*.lifecycle *dresources.AppStateLifecycle REMOTE STATE -resources.apps.*.lifecycle *resources.LifecycleWithStarted INPUT -resources.apps.*.lifecycle resources.Lifecycle INPUT -resources.apps.*.lifecycle.prevent_destroy bool INPUT -resources.apps.*.lifecycle.started *bool ALL -resources.apps.*.modified_status string INPUT -resources.apps.*.name string ALL -resources.apps.*.oauth2_app_client_id string ALL -resources.apps.*.oauth2_app_integration_id string ALL -resources.apps.*.pending_deployment *apps.AppDeployment ALL -resources.apps.*.pending_deployment.command []string ALL -resources.apps.*.pending_deployment.command[*] string ALL -resources.apps.*.pending_deployment.create_time string ALL -resources.apps.*.pending_deployment.creator string ALL -resources.apps.*.pending_deployment.deployment_artifacts *apps.AppDeploymentArtifacts ALL -resources.apps.*.pending_deployment.deployment_artifacts.source_code_path string ALL -resources.apps.*.pending_deployment.deployment_id string ALL -resources.apps.*.pending_deployment.env_vars []apps.EnvVar ALL -resources.apps.*.pending_deployment.env_vars[*] apps.EnvVar ALL -resources.apps.*.pending_deployment.env_vars[*].name string ALL -resources.apps.*.pending_deployment.env_vars[*].value string ALL -resources.apps.*.pending_deployment.env_vars[*].value_from string ALL -resources.apps.*.pending_deployment.git_source *apps.GitSource ALL -resources.apps.*.pending_deployment.git_source.branch string ALL -resources.apps.*.pending_deployment.git_source.commit string ALL -resources.apps.*.pending_deployment.git_source.git_repository *apps.GitRepository ALL -resources.apps.*.pending_deployment.git_source.git_repository.provider string ALL -resources.apps.*.pending_deployment.git_source.git_repository.url string ALL -resources.apps.*.pending_deployment.git_source.resolved_commit string ALL -resources.apps.*.pending_deployment.git_source.source_code_path string ALL -resources.apps.*.pending_deployment.git_source.tag string ALL -resources.apps.*.pending_deployment.mode apps.AppDeploymentMode ALL -resources.apps.*.pending_deployment.source_code_path string ALL -resources.apps.*.pending_deployment.status *apps.AppDeploymentStatus ALL -resources.apps.*.pending_deployment.status.message string ALL -resources.apps.*.pending_deployment.status.state apps.AppDeploymentState ALL -resources.apps.*.pending_deployment.update_time string ALL -resources.apps.*.resources []apps.AppResource ALL -resources.apps.*.resources[*] apps.AppResource ALL -resources.apps.*.resources[*].app *apps.AppResourceApp ALL -resources.apps.*.resources[*].app.name string ALL -resources.apps.*.resources[*].app.permission apps.AppResourceAppAppPermission ALL -resources.apps.*.resources[*].database *apps.AppResourceDatabase ALL -resources.apps.*.resources[*].database.database_name string ALL -resources.apps.*.resources[*].database.instance_name string ALL -resources.apps.*.resources[*].database.permission apps.AppResourceDatabaseDatabasePermission ALL -resources.apps.*.resources[*].description string ALL -resources.apps.*.resources[*].experiment *apps.AppResourceExperiment ALL -resources.apps.*.resources[*].experiment.experiment_id string ALL -resources.apps.*.resources[*].experiment.permission apps.AppResourceExperimentExperimentPermission ALL -resources.apps.*.resources[*].genie_space *apps.AppResourceGenieSpace ALL -resources.apps.*.resources[*].genie_space.name string ALL -resources.apps.*.resources[*].genie_space.permission apps.AppResourceGenieSpaceGenieSpacePermission ALL -resources.apps.*.resources[*].genie_space.space_id string ALL -resources.apps.*.resources[*].job *apps.AppResourceJob ALL -resources.apps.*.resources[*].job.id string ALL -resources.apps.*.resources[*].job.permission apps.AppResourceJobJobPermission ALL -resources.apps.*.resources[*].name string ALL -resources.apps.*.resources[*].postgres *apps.AppResourcePostgres ALL -resources.apps.*.resources[*].postgres.branch string ALL -resources.apps.*.resources[*].postgres.database string ALL -resources.apps.*.resources[*].postgres.permission apps.AppResourcePostgresPostgresPermission ALL -resources.apps.*.resources[*].secret *apps.AppResourceSecret ALL -resources.apps.*.resources[*].secret.key string ALL -resources.apps.*.resources[*].secret.permission apps.AppResourceSecretSecretPermission ALL -resources.apps.*.resources[*].secret.scope string ALL -resources.apps.*.resources[*].serving_endpoint *apps.AppResourceServingEndpoint ALL -resources.apps.*.resources[*].serving_endpoint.name string ALL -resources.apps.*.resources[*].serving_endpoint.permission apps.AppResourceServingEndpointServingEndpointPermission ALL -resources.apps.*.resources[*].sql_warehouse *apps.AppResourceSqlWarehouse ALL -resources.apps.*.resources[*].sql_warehouse.id string ALL -resources.apps.*.resources[*].sql_warehouse.permission apps.AppResourceSqlWarehouseSqlWarehousePermission ALL -resources.apps.*.resources[*].uc_securable *apps.AppResourceUcSecurable ALL -resources.apps.*.resources[*].uc_securable.permission apps.AppResourceUcSecurableUcSecurablePermission ALL -resources.apps.*.resources[*].uc_securable.securable_full_name string ALL -resources.apps.*.resources[*].uc_securable.securable_kind string ALL -resources.apps.*.resources[*].uc_securable.securable_type apps.AppResourceUcSecurableUcSecurableType ALL -resources.apps.*.service_principal_client_id string ALL -resources.apps.*.service_principal_id int64 ALL -resources.apps.*.service_principal_name string ALL -resources.apps.*.source_code_path string ALL -resources.apps.*.space string ALL -resources.apps.*.telemetry_export_destinations []apps.TelemetryExportDestination ALL -resources.apps.*.telemetry_export_destinations[*] apps.TelemetryExportDestination ALL -resources.apps.*.telemetry_export_destinations[*].unity_catalog *apps.UnityCatalog ALL -resources.apps.*.telemetry_export_destinations[*].unity_catalog.logs_table string ALL -resources.apps.*.telemetry_export_destinations[*].unity_catalog.metrics_table string ALL -resources.apps.*.telemetry_export_destinations[*].unity_catalog.traces_table string ALL -resources.apps.*.thumbnail_url string ALL -resources.apps.*.update_time string ALL -resources.apps.*.updater string ALL -resources.apps.*.url string ALL -resources.apps.*.usage_policy_id string ALL -resources.apps.*.user_api_scopes []string ALL -resources.apps.*.user_api_scopes[*] string ALL -resources.apps.*.permissions.object_id string ALL -resources.apps.*.permissions[*] dresources.StatePermission ALL -resources.apps.*.permissions[*].group_name string ALL -resources.apps.*.permissions[*].level iam.PermissionLevel ALL -resources.apps.*.permissions[*].service_principal_name string ALL -resources.apps.*.permissions[*].user_name string ALL -resources.catalogs.*.browse_only bool REMOTE -resources.catalogs.*.catalog_type catalog.CatalogType REMOTE -resources.catalogs.*.comment string ALL -resources.catalogs.*.connection_name string ALL -resources.catalogs.*.created_at int64 REMOTE -resources.catalogs.*.created_by string REMOTE -resources.catalogs.*.effective_predictive_optimization_flag *catalog.EffectivePredictiveOptimizationFlag REMOTE -resources.catalogs.*.effective_predictive_optimization_flag.inherited_from_name string REMOTE -resources.catalogs.*.effective_predictive_optimization_flag.inherited_from_type catalog.EffectivePredictiveOptimizationFlagInheritedFromType REMOTE -resources.catalogs.*.effective_predictive_optimization_flag.value catalog.EnablePredictiveOptimization REMOTE -resources.catalogs.*.enable_predictive_optimization catalog.EnablePredictiveOptimization REMOTE -resources.catalogs.*.full_name string REMOTE -resources.catalogs.*.id string INPUT -resources.catalogs.*.isolation_mode catalog.CatalogIsolationMode REMOTE -resources.catalogs.*.lifecycle resources.Lifecycle INPUT -resources.catalogs.*.lifecycle.prevent_destroy bool INPUT -resources.catalogs.*.managed_encryption_settings *catalog.EncryptionSettings ALL -resources.catalogs.*.managed_encryption_settings.azure_encryption_settings *catalog.AzureEncryptionSettings ALL -resources.catalogs.*.managed_encryption_settings.azure_encryption_settings.azure_cmk_access_connector_id string ALL -resources.catalogs.*.managed_encryption_settings.azure_encryption_settings.azure_cmk_managed_identity_id string ALL -resources.catalogs.*.managed_encryption_settings.azure_encryption_settings.azure_tenant_id string ALL -resources.catalogs.*.managed_encryption_settings.azure_key_vault_key_id string ALL -resources.catalogs.*.managed_encryption_settings.customer_managed_key_id string ALL -resources.catalogs.*.metastore_id string REMOTE -resources.catalogs.*.modified_status string INPUT -resources.catalogs.*.name string ALL -resources.catalogs.*.options map[string]string ALL -resources.catalogs.*.options.* string ALL -resources.catalogs.*.owner string REMOTE -resources.catalogs.*.properties map[string]string ALL -resources.catalogs.*.properties.* string ALL -resources.catalogs.*.provider_name string ALL -resources.catalogs.*.provisioning_info *catalog.ProvisioningInfo REMOTE -resources.catalogs.*.provisioning_info.state catalog.ProvisioningInfoState REMOTE -resources.catalogs.*.securable_type catalog.SecurableType REMOTE -resources.catalogs.*.share_name string ALL -resources.catalogs.*.storage_location string REMOTE -resources.catalogs.*.storage_root string ALL -resources.catalogs.*.updated_at int64 REMOTE -resources.catalogs.*.updated_by string REMOTE -resources.catalogs.*.url string INPUT -resources.catalogs.*.grants.full_name string ALL -resources.catalogs.*.grants.securable_type string ALL -resources.catalogs.*.grants[*] catalog.PrivilegeAssignment ALL -resources.catalogs.*.grants[*].principal string ALL -resources.catalogs.*.grants[*].privileges []catalog.Privilege ALL -resources.catalogs.*.grants[*].privileges[*] catalog.Privilege ALL -resources.clusters.*.apply_policy_default_values bool INPUT STATE -resources.clusters.*.autoscale *compute.AutoScale ALL -resources.clusters.*.autoscale.max_workers int ALL -resources.clusters.*.autoscale.min_workers int ALL -resources.clusters.*.autotermination_minutes int ALL -resources.clusters.*.aws_attributes *compute.AwsAttributes ALL -resources.clusters.*.aws_attributes.availability compute.AwsAvailability ALL -resources.clusters.*.aws_attributes.ebs_volume_count int ALL -resources.clusters.*.aws_attributes.ebs_volume_iops int ALL -resources.clusters.*.aws_attributes.ebs_volume_size int ALL -resources.clusters.*.aws_attributes.ebs_volume_throughput int ALL -resources.clusters.*.aws_attributes.ebs_volume_type compute.EbsVolumeType ALL -resources.clusters.*.aws_attributes.first_on_demand int ALL -resources.clusters.*.aws_attributes.instance_profile_arn string ALL -resources.clusters.*.aws_attributes.spot_bid_price_percent int ALL -resources.clusters.*.aws_attributes.zone_id string ALL -resources.clusters.*.azure_attributes *compute.AzureAttributes ALL -resources.clusters.*.azure_attributes.availability compute.AzureAvailability ALL -resources.clusters.*.azure_attributes.first_on_demand int ALL -resources.clusters.*.azure_attributes.log_analytics_info *compute.LogAnalyticsInfo ALL -resources.clusters.*.azure_attributes.log_analytics_info.log_analytics_primary_key string ALL -resources.clusters.*.azure_attributes.log_analytics_info.log_analytics_workspace_id string ALL -resources.clusters.*.azure_attributes.spot_bid_max_price float64 ALL -resources.clusters.*.cluster_cores float64 REMOTE -resources.clusters.*.cluster_id string REMOTE -resources.clusters.*.cluster_log_conf *compute.ClusterLogConf ALL -resources.clusters.*.cluster_log_conf.dbfs *compute.DbfsStorageInfo ALL -resources.clusters.*.cluster_log_conf.dbfs.destination string ALL -resources.clusters.*.cluster_log_conf.s3 *compute.S3StorageInfo ALL -resources.clusters.*.cluster_log_conf.s3.canned_acl string ALL -resources.clusters.*.cluster_log_conf.s3.destination string ALL -resources.clusters.*.cluster_log_conf.s3.enable_encryption bool ALL -resources.clusters.*.cluster_log_conf.s3.encryption_type string ALL -resources.clusters.*.cluster_log_conf.s3.endpoint string ALL -resources.clusters.*.cluster_log_conf.s3.kms_key string ALL -resources.clusters.*.cluster_log_conf.s3.region string ALL -resources.clusters.*.cluster_log_conf.volumes *compute.VolumesStorageInfo ALL -resources.clusters.*.cluster_log_conf.volumes.destination string ALL -resources.clusters.*.cluster_log_status *compute.LogSyncStatus REMOTE -resources.clusters.*.cluster_log_status.last_attempted int64 REMOTE -resources.clusters.*.cluster_log_status.last_exception string REMOTE -resources.clusters.*.cluster_memory_mb int64 REMOTE -resources.clusters.*.cluster_name string ALL -resources.clusters.*.cluster_source compute.ClusterSource REMOTE -resources.clusters.*.creator_user_name string REMOTE -resources.clusters.*.custom_tags map[string]string ALL -resources.clusters.*.custom_tags.* string ALL -resources.clusters.*.data_security_mode compute.DataSecurityMode ALL -resources.clusters.*.default_tags map[string]string REMOTE -resources.clusters.*.default_tags.* string REMOTE -resources.clusters.*.docker_image *compute.DockerImage ALL -resources.clusters.*.docker_image.basic_auth *compute.DockerBasicAuth ALL -resources.clusters.*.docker_image.basic_auth.password string ALL -resources.clusters.*.docker_image.basic_auth.username string ALL -resources.clusters.*.docker_image.url string ALL -resources.clusters.*.driver *compute.SparkNode REMOTE -resources.clusters.*.driver.host_private_ip string REMOTE -resources.clusters.*.driver.instance_id string REMOTE -resources.clusters.*.driver.node_aws_attributes *compute.SparkNodeAwsAttributes REMOTE -resources.clusters.*.driver.node_aws_attributes.is_spot bool REMOTE -resources.clusters.*.driver.node_id string REMOTE -resources.clusters.*.driver.private_ip string REMOTE -resources.clusters.*.driver.public_dns string REMOTE -resources.clusters.*.driver.start_timestamp int64 REMOTE -resources.clusters.*.driver_instance_pool_id string ALL -resources.clusters.*.driver_node_type_flexibility *compute.NodeTypeFlexibility ALL -resources.clusters.*.driver_node_type_flexibility.alternate_node_type_ids []string ALL -resources.clusters.*.driver_node_type_flexibility.alternate_node_type_ids[*] string ALL -resources.clusters.*.driver_node_type_id string ALL -resources.clusters.*.enable_elastic_disk bool ALL -resources.clusters.*.enable_local_disk_encryption bool ALL -resources.clusters.*.executors []compute.SparkNode REMOTE -resources.clusters.*.executors[*] compute.SparkNode REMOTE -resources.clusters.*.executors[*].host_private_ip string REMOTE -resources.clusters.*.executors[*].instance_id string REMOTE -resources.clusters.*.executors[*].node_aws_attributes *compute.SparkNodeAwsAttributes REMOTE -resources.clusters.*.executors[*].node_aws_attributes.is_spot bool REMOTE -resources.clusters.*.executors[*].node_id string REMOTE -resources.clusters.*.executors[*].private_ip string REMOTE -resources.clusters.*.executors[*].public_dns string REMOTE -resources.clusters.*.executors[*].start_timestamp int64 REMOTE -resources.clusters.*.gcp_attributes *compute.GcpAttributes ALL -resources.clusters.*.gcp_attributes.availability compute.GcpAvailability ALL -resources.clusters.*.gcp_attributes.boot_disk_size int ALL -resources.clusters.*.gcp_attributes.confidential_compute_type compute.ConfidentialComputeType ALL -resources.clusters.*.gcp_attributes.first_on_demand int ALL -resources.clusters.*.gcp_attributes.google_service_account string ALL -resources.clusters.*.gcp_attributes.local_ssd_count int ALL -resources.clusters.*.gcp_attributes.use_preemptible_executors bool ALL -resources.clusters.*.gcp_attributes.zone_id string ALL -resources.clusters.*.id string INPUT -resources.clusters.*.init_scripts []compute.InitScriptInfo ALL -resources.clusters.*.init_scripts[*] compute.InitScriptInfo ALL -resources.clusters.*.init_scripts[*].abfss *compute.Adlsgen2Info ALL -resources.clusters.*.init_scripts[*].abfss.destination string ALL -resources.clusters.*.init_scripts[*].dbfs *compute.DbfsStorageInfo ALL -resources.clusters.*.init_scripts[*].dbfs.destination string ALL -resources.clusters.*.init_scripts[*].file *compute.LocalFileInfo ALL -resources.clusters.*.init_scripts[*].file.destination string ALL -resources.clusters.*.init_scripts[*].gcs *compute.GcsStorageInfo ALL -resources.clusters.*.init_scripts[*].gcs.destination string ALL -resources.clusters.*.init_scripts[*].s3 *compute.S3StorageInfo ALL -resources.clusters.*.init_scripts[*].s3.canned_acl string ALL -resources.clusters.*.init_scripts[*].s3.destination string ALL -resources.clusters.*.init_scripts[*].s3.enable_encryption bool ALL -resources.clusters.*.init_scripts[*].s3.encryption_type string ALL -resources.clusters.*.init_scripts[*].s3.endpoint string ALL -resources.clusters.*.init_scripts[*].s3.kms_key string ALL -resources.clusters.*.init_scripts[*].s3.region string ALL -resources.clusters.*.init_scripts[*].volumes *compute.VolumesStorageInfo ALL -resources.clusters.*.init_scripts[*].volumes.destination string ALL -resources.clusters.*.init_scripts[*].workspace *compute.WorkspaceStorageInfo ALL -resources.clusters.*.init_scripts[*].workspace.destination string ALL -resources.clusters.*.instance_pool_id string ALL -resources.clusters.*.is_single_node bool ALL -resources.clusters.*.jdbc_port int REMOTE -resources.clusters.*.kind compute.Kind ALL -resources.clusters.*.last_restarted_time int64 REMOTE -resources.clusters.*.last_state_loss_time int64 REMOTE -resources.clusters.*.lifecycle resources.Lifecycle INPUT -resources.clusters.*.lifecycle.prevent_destroy bool INPUT -resources.clusters.*.modified_status string INPUT -resources.clusters.*.node_type_id string ALL -resources.clusters.*.num_workers int ALL -resources.clusters.*.policy_id string ALL -resources.clusters.*.remote_disk_throughput int ALL -resources.clusters.*.runtime_engine compute.RuntimeEngine ALL -resources.clusters.*.single_user_name string ALL -resources.clusters.*.spark_conf map[string]string ALL -resources.clusters.*.spark_conf.* string ALL -resources.clusters.*.spark_context_id int64 REMOTE -resources.clusters.*.spark_env_vars map[string]string ALL -resources.clusters.*.spark_env_vars.* string ALL -resources.clusters.*.spark_version string ALL -resources.clusters.*.spec *compute.ClusterSpec REMOTE -resources.clusters.*.spec.apply_policy_default_values bool REMOTE -resources.clusters.*.spec.autoscale *compute.AutoScale REMOTE -resources.clusters.*.spec.autoscale.max_workers int REMOTE -resources.clusters.*.spec.autoscale.min_workers int REMOTE -resources.clusters.*.spec.autotermination_minutes int REMOTE -resources.clusters.*.spec.aws_attributes *compute.AwsAttributes REMOTE -resources.clusters.*.spec.aws_attributes.availability compute.AwsAvailability REMOTE -resources.clusters.*.spec.aws_attributes.ebs_volume_count int REMOTE -resources.clusters.*.spec.aws_attributes.ebs_volume_iops int REMOTE -resources.clusters.*.spec.aws_attributes.ebs_volume_size int REMOTE -resources.clusters.*.spec.aws_attributes.ebs_volume_throughput int REMOTE -resources.clusters.*.spec.aws_attributes.ebs_volume_type compute.EbsVolumeType REMOTE -resources.clusters.*.spec.aws_attributes.first_on_demand int REMOTE -resources.clusters.*.spec.aws_attributes.instance_profile_arn string REMOTE -resources.clusters.*.spec.aws_attributes.spot_bid_price_percent int REMOTE -resources.clusters.*.spec.aws_attributes.zone_id string REMOTE -resources.clusters.*.spec.azure_attributes *compute.AzureAttributes REMOTE -resources.clusters.*.spec.azure_attributes.availability compute.AzureAvailability REMOTE -resources.clusters.*.spec.azure_attributes.first_on_demand int REMOTE -resources.clusters.*.spec.azure_attributes.log_analytics_info *compute.LogAnalyticsInfo REMOTE -resources.clusters.*.spec.azure_attributes.log_analytics_info.log_analytics_primary_key string REMOTE -resources.clusters.*.spec.azure_attributes.log_analytics_info.log_analytics_workspace_id string REMOTE -resources.clusters.*.spec.azure_attributes.spot_bid_max_price float64 REMOTE -resources.clusters.*.spec.cluster_log_conf *compute.ClusterLogConf REMOTE -resources.clusters.*.spec.cluster_log_conf.dbfs *compute.DbfsStorageInfo REMOTE -resources.clusters.*.spec.cluster_log_conf.dbfs.destination string REMOTE -resources.clusters.*.spec.cluster_log_conf.s3 *compute.S3StorageInfo REMOTE -resources.clusters.*.spec.cluster_log_conf.s3.canned_acl string REMOTE -resources.clusters.*.spec.cluster_log_conf.s3.destination string REMOTE -resources.clusters.*.spec.cluster_log_conf.s3.enable_encryption bool REMOTE -resources.clusters.*.spec.cluster_log_conf.s3.encryption_type string REMOTE -resources.clusters.*.spec.cluster_log_conf.s3.endpoint string REMOTE -resources.clusters.*.spec.cluster_log_conf.s3.kms_key string REMOTE -resources.clusters.*.spec.cluster_log_conf.s3.region string REMOTE -resources.clusters.*.spec.cluster_log_conf.volumes *compute.VolumesStorageInfo REMOTE -resources.clusters.*.spec.cluster_log_conf.volumes.destination string REMOTE -resources.clusters.*.spec.cluster_name string REMOTE -resources.clusters.*.spec.custom_tags map[string]string REMOTE -resources.clusters.*.spec.custom_tags.* string REMOTE -resources.clusters.*.spec.data_security_mode compute.DataSecurityMode REMOTE -resources.clusters.*.spec.docker_image *compute.DockerImage REMOTE -resources.clusters.*.spec.docker_image.basic_auth *compute.DockerBasicAuth REMOTE -resources.clusters.*.spec.docker_image.basic_auth.password string REMOTE -resources.clusters.*.spec.docker_image.basic_auth.username string REMOTE -resources.clusters.*.spec.docker_image.url string REMOTE -resources.clusters.*.spec.driver_instance_pool_id string REMOTE -resources.clusters.*.spec.driver_node_type_flexibility *compute.NodeTypeFlexibility REMOTE -resources.clusters.*.spec.driver_node_type_flexibility.alternate_node_type_ids []string REMOTE -resources.clusters.*.spec.driver_node_type_flexibility.alternate_node_type_ids[*] string REMOTE -resources.clusters.*.spec.driver_node_type_id string REMOTE -resources.clusters.*.spec.enable_elastic_disk bool REMOTE -resources.clusters.*.spec.enable_local_disk_encryption bool REMOTE -resources.clusters.*.spec.gcp_attributes *compute.GcpAttributes REMOTE -resources.clusters.*.spec.gcp_attributes.availability compute.GcpAvailability REMOTE -resources.clusters.*.spec.gcp_attributes.boot_disk_size int REMOTE -resources.clusters.*.spec.gcp_attributes.confidential_compute_type compute.ConfidentialComputeType REMOTE -resources.clusters.*.spec.gcp_attributes.first_on_demand int REMOTE -resources.clusters.*.spec.gcp_attributes.google_service_account string REMOTE -resources.clusters.*.spec.gcp_attributes.local_ssd_count int REMOTE -resources.clusters.*.spec.gcp_attributes.use_preemptible_executors bool REMOTE -resources.clusters.*.spec.gcp_attributes.zone_id string REMOTE -resources.clusters.*.spec.init_scripts []compute.InitScriptInfo REMOTE -resources.clusters.*.spec.init_scripts[*] compute.InitScriptInfo REMOTE -resources.clusters.*.spec.init_scripts[*].abfss *compute.Adlsgen2Info REMOTE -resources.clusters.*.spec.init_scripts[*].abfss.destination string REMOTE -resources.clusters.*.spec.init_scripts[*].dbfs *compute.DbfsStorageInfo REMOTE -resources.clusters.*.spec.init_scripts[*].dbfs.destination string REMOTE -resources.clusters.*.spec.init_scripts[*].file *compute.LocalFileInfo REMOTE -resources.clusters.*.spec.init_scripts[*].file.destination string REMOTE -resources.clusters.*.spec.init_scripts[*].gcs *compute.GcsStorageInfo REMOTE -resources.clusters.*.spec.init_scripts[*].gcs.destination string REMOTE -resources.clusters.*.spec.init_scripts[*].s3 *compute.S3StorageInfo REMOTE -resources.clusters.*.spec.init_scripts[*].s3.canned_acl string REMOTE -resources.clusters.*.spec.init_scripts[*].s3.destination string REMOTE -resources.clusters.*.spec.init_scripts[*].s3.enable_encryption bool REMOTE -resources.clusters.*.spec.init_scripts[*].s3.encryption_type string REMOTE -resources.clusters.*.spec.init_scripts[*].s3.endpoint string REMOTE -resources.clusters.*.spec.init_scripts[*].s3.kms_key string REMOTE -resources.clusters.*.spec.init_scripts[*].s3.region string REMOTE -resources.clusters.*.spec.init_scripts[*].volumes *compute.VolumesStorageInfo REMOTE -resources.clusters.*.spec.init_scripts[*].volumes.destination string REMOTE -resources.clusters.*.spec.init_scripts[*].workspace *compute.WorkspaceStorageInfo REMOTE -resources.clusters.*.spec.init_scripts[*].workspace.destination string REMOTE -resources.clusters.*.spec.instance_pool_id string REMOTE -resources.clusters.*.spec.is_single_node bool REMOTE -resources.clusters.*.spec.kind compute.Kind REMOTE -resources.clusters.*.spec.node_type_id string REMOTE -resources.clusters.*.spec.num_workers int REMOTE -resources.clusters.*.spec.policy_id string REMOTE -resources.clusters.*.spec.remote_disk_throughput int REMOTE -resources.clusters.*.spec.runtime_engine compute.RuntimeEngine REMOTE -resources.clusters.*.spec.single_user_name string REMOTE -resources.clusters.*.spec.spark_conf map[string]string REMOTE -resources.clusters.*.spec.spark_conf.* string REMOTE -resources.clusters.*.spec.spark_env_vars map[string]string REMOTE -resources.clusters.*.spec.spark_env_vars.* string REMOTE -resources.clusters.*.spec.spark_version string REMOTE -resources.clusters.*.spec.ssh_public_keys []string REMOTE -resources.clusters.*.spec.ssh_public_keys[*] string REMOTE -resources.clusters.*.spec.total_initial_remote_disk_size int REMOTE -resources.clusters.*.spec.use_ml_runtime bool REMOTE -resources.clusters.*.spec.worker_node_type_flexibility *compute.NodeTypeFlexibility REMOTE -resources.clusters.*.spec.worker_node_type_flexibility.alternate_node_type_ids []string REMOTE -resources.clusters.*.spec.worker_node_type_flexibility.alternate_node_type_ids[*] string REMOTE -resources.clusters.*.spec.workload_type *compute.WorkloadType REMOTE -resources.clusters.*.spec.workload_type.clients compute.ClientsTypes REMOTE -resources.clusters.*.spec.workload_type.clients.jobs bool REMOTE -resources.clusters.*.spec.workload_type.clients.notebooks bool REMOTE -resources.clusters.*.ssh_public_keys []string ALL -resources.clusters.*.ssh_public_keys[*] string ALL -resources.clusters.*.start_time int64 REMOTE -resources.clusters.*.state compute.State REMOTE -resources.clusters.*.state_message string REMOTE -resources.clusters.*.terminated_time int64 REMOTE -resources.clusters.*.termination_reason *compute.TerminationReason REMOTE -resources.clusters.*.termination_reason.code compute.TerminationReasonCode REMOTE -resources.clusters.*.termination_reason.parameters map[string]string REMOTE -resources.clusters.*.termination_reason.parameters.* string REMOTE -resources.clusters.*.termination_reason.type compute.TerminationReasonType REMOTE -resources.clusters.*.total_initial_remote_disk_size int ALL -resources.clusters.*.url string INPUT -resources.clusters.*.use_ml_runtime bool ALL -resources.clusters.*.worker_node_type_flexibility *compute.NodeTypeFlexibility ALL -resources.clusters.*.worker_node_type_flexibility.alternate_node_type_ids []string ALL -resources.clusters.*.worker_node_type_flexibility.alternate_node_type_ids[*] string ALL -resources.clusters.*.workload_type *compute.WorkloadType ALL -resources.clusters.*.workload_type.clients compute.ClientsTypes ALL -resources.clusters.*.workload_type.clients.jobs bool ALL -resources.clusters.*.workload_type.clients.notebooks bool ALL -resources.clusters.*.permissions.object_id string ALL -resources.clusters.*.permissions[*] dresources.StatePermission ALL -resources.clusters.*.permissions[*].group_name string ALL -resources.clusters.*.permissions[*].level iam.PermissionLevel ALL -resources.clusters.*.permissions[*].service_principal_name string ALL -resources.clusters.*.permissions[*].user_name string ALL -resources.dashboards.*.create_time string ALL -resources.dashboards.*.dashboard_id string ALL -resources.dashboards.*.dataset_catalog string ALL -resources.dashboards.*.dataset_schema string ALL -resources.dashboards.*.display_name string ALL -resources.dashboards.*.embed_credentials bool ALL -resources.dashboards.*.etag string ALL -resources.dashboards.*.file_path string INPUT -resources.dashboards.*.id string INPUT -resources.dashboards.*.lifecycle resources.Lifecycle INPUT -resources.dashboards.*.lifecycle.prevent_destroy bool INPUT -resources.dashboards.*.lifecycle_state dashboards.LifecycleState ALL -resources.dashboards.*.modified_status string INPUT -resources.dashboards.*.parent_path string ALL -resources.dashboards.*.path string ALL -resources.dashboards.*.published bool REMOTE STATE -resources.dashboards.*.serialized_dashboard any ALL -resources.dashboards.*.update_time string ALL -resources.dashboards.*.url string INPUT -resources.dashboards.*.warehouse_id string ALL -resources.dashboards.*.permissions.object_id string ALL -resources.dashboards.*.permissions[*] dresources.StatePermission ALL -resources.dashboards.*.permissions[*].group_name string ALL -resources.dashboards.*.permissions[*].level iam.PermissionLevel ALL -resources.dashboards.*.permissions[*].service_principal_name string ALL -resources.dashboards.*.permissions[*].user_name string ALL -resources.database_catalogs.*.create_database_if_not_exists bool ALL -resources.database_catalogs.*.database_instance_name string ALL -resources.database_catalogs.*.database_name string ALL -resources.database_catalogs.*.id string INPUT -resources.database_catalogs.*.lifecycle resources.Lifecycle INPUT -resources.database_catalogs.*.lifecycle.prevent_destroy bool INPUT -resources.database_catalogs.*.modified_status string INPUT -resources.database_catalogs.*.name string ALL -resources.database_catalogs.*.uid string ALL -resources.database_catalogs.*.url string INPUT -resources.database_instances.*.capacity string ALL -resources.database_instances.*.child_instance_refs []database.DatabaseInstanceRef ALL -resources.database_instances.*.child_instance_refs[*] database.DatabaseInstanceRef ALL -resources.database_instances.*.child_instance_refs[*].branch_time string ALL -resources.database_instances.*.child_instance_refs[*].effective_lsn string ALL -resources.database_instances.*.child_instance_refs[*].lsn string ALL -resources.database_instances.*.child_instance_refs[*].name string ALL -resources.database_instances.*.child_instance_refs[*].uid string ALL -resources.database_instances.*.creation_time string ALL -resources.database_instances.*.creator string ALL -resources.database_instances.*.custom_tags []database.CustomTag ALL -resources.database_instances.*.custom_tags[*] database.CustomTag ALL -resources.database_instances.*.custom_tags[*].key string ALL -resources.database_instances.*.custom_tags[*].value string ALL -resources.database_instances.*.effective_capacity string ALL -resources.database_instances.*.effective_custom_tags []database.CustomTag ALL -resources.database_instances.*.effective_custom_tags[*] database.CustomTag ALL -resources.database_instances.*.effective_custom_tags[*].key string ALL -resources.database_instances.*.effective_custom_tags[*].value string ALL -resources.database_instances.*.effective_enable_pg_native_login bool ALL -resources.database_instances.*.effective_enable_readable_secondaries bool ALL -resources.database_instances.*.effective_node_count int ALL -resources.database_instances.*.effective_retention_window_in_days int ALL -resources.database_instances.*.effective_stopped bool ALL -resources.database_instances.*.effective_usage_policy_id string ALL -resources.database_instances.*.enable_pg_native_login bool ALL -resources.database_instances.*.enable_readable_secondaries bool ALL -resources.database_instances.*.id string INPUT -resources.database_instances.*.lifecycle resources.Lifecycle INPUT -resources.database_instances.*.lifecycle.prevent_destroy bool INPUT -resources.database_instances.*.modified_status string INPUT -resources.database_instances.*.name string ALL -resources.database_instances.*.node_count int ALL -resources.database_instances.*.parent_instance_ref *database.DatabaseInstanceRef ALL -resources.database_instances.*.parent_instance_ref.branch_time string ALL -resources.database_instances.*.parent_instance_ref.effective_lsn string ALL -resources.database_instances.*.parent_instance_ref.lsn string ALL -resources.database_instances.*.parent_instance_ref.name string ALL -resources.database_instances.*.parent_instance_ref.uid string ALL -resources.database_instances.*.pg_version string ALL -resources.database_instances.*.read_only_dns string ALL -resources.database_instances.*.read_write_dns string ALL -resources.database_instances.*.retention_window_in_days int ALL -resources.database_instances.*.state database.DatabaseInstanceState ALL -resources.database_instances.*.stopped bool ALL -resources.database_instances.*.uid string ALL -resources.database_instances.*.url string INPUT -resources.database_instances.*.usage_policy_id string ALL -resources.database_instances.*.permissions.object_id string ALL -resources.database_instances.*.permissions[*] dresources.StatePermission ALL -resources.database_instances.*.permissions[*].group_name string ALL -resources.database_instances.*.permissions[*].level iam.PermissionLevel ALL -resources.database_instances.*.permissions[*].service_principal_name string ALL -resources.database_instances.*.permissions[*].user_name string ALL -resources.experiments.*.artifact_location string ALL -resources.experiments.*.creation_time int64 REMOTE -resources.experiments.*.experiment_id string REMOTE -resources.experiments.*.id string INPUT -resources.experiments.*.last_update_time int64 REMOTE -resources.experiments.*.lifecycle resources.Lifecycle INPUT -resources.experiments.*.lifecycle.prevent_destroy bool INPUT -resources.experiments.*.lifecycle_stage string REMOTE -resources.experiments.*.modified_status string INPUT -resources.experiments.*.name string ALL -resources.experiments.*.tags []ml.ExperimentTag ALL -resources.experiments.*.tags[*] ml.ExperimentTag ALL -resources.experiments.*.tags[*].key string ALL -resources.experiments.*.tags[*].value string ALL -resources.experiments.*.url string INPUT -resources.experiments.*.permissions.object_id string ALL -resources.experiments.*.permissions[*] dresources.StatePermission ALL -resources.experiments.*.permissions[*].group_name string ALL -resources.experiments.*.permissions[*].level iam.PermissionLevel ALL -resources.experiments.*.permissions[*].service_principal_name string ALL -resources.experiments.*.permissions[*].user_name string ALL -resources.external_locations.*.browse_only bool REMOTE -resources.external_locations.*.comment string ALL -resources.external_locations.*.created_at int64 REMOTE -resources.external_locations.*.created_by string REMOTE -resources.external_locations.*.credential_id string REMOTE -resources.external_locations.*.credential_name string ALL -resources.external_locations.*.effective_enable_file_events bool ALL -resources.external_locations.*.effective_file_event_queue *catalog.FileEventQueue ALL -resources.external_locations.*.effective_file_event_queue.managed_aqs *catalog.AzureQueueStorage ALL -resources.external_locations.*.effective_file_event_queue.managed_aqs.managed_resource_id string ALL -resources.external_locations.*.effective_file_event_queue.managed_aqs.queue_url string ALL -resources.external_locations.*.effective_file_event_queue.managed_aqs.resource_group string ALL -resources.external_locations.*.effective_file_event_queue.managed_aqs.subscription_id string ALL -resources.external_locations.*.effective_file_event_queue.managed_pubsub *catalog.GcpPubsub ALL -resources.external_locations.*.effective_file_event_queue.managed_pubsub.managed_resource_id string ALL -resources.external_locations.*.effective_file_event_queue.managed_pubsub.subscription_name string ALL -resources.external_locations.*.effective_file_event_queue.managed_sqs *catalog.AwsSqsQueue ALL -resources.external_locations.*.effective_file_event_queue.managed_sqs.managed_resource_id string ALL -resources.external_locations.*.effective_file_event_queue.managed_sqs.queue_url string ALL -resources.external_locations.*.effective_file_event_queue.provided_aqs *catalog.AzureQueueStorage ALL -resources.external_locations.*.effective_file_event_queue.provided_aqs.managed_resource_id string ALL -resources.external_locations.*.effective_file_event_queue.provided_aqs.queue_url string ALL -resources.external_locations.*.effective_file_event_queue.provided_aqs.resource_group string ALL -resources.external_locations.*.effective_file_event_queue.provided_aqs.subscription_id string ALL -resources.external_locations.*.effective_file_event_queue.provided_pubsub *catalog.GcpPubsub ALL -resources.external_locations.*.effective_file_event_queue.provided_pubsub.managed_resource_id string ALL -resources.external_locations.*.effective_file_event_queue.provided_pubsub.subscription_name string ALL -resources.external_locations.*.effective_file_event_queue.provided_sqs *catalog.AwsSqsQueue ALL -resources.external_locations.*.effective_file_event_queue.provided_sqs.managed_resource_id string ALL -resources.external_locations.*.effective_file_event_queue.provided_sqs.queue_url string ALL -resources.external_locations.*.enable_file_events bool ALL -resources.external_locations.*.encryption_details *catalog.EncryptionDetails ALL -resources.external_locations.*.encryption_details.sse_encryption_details *catalog.SseEncryptionDetails ALL -resources.external_locations.*.encryption_details.sse_encryption_details.algorithm catalog.SseEncryptionDetailsAlgorithm ALL -resources.external_locations.*.encryption_details.sse_encryption_details.aws_kms_key_arn string ALL -resources.external_locations.*.fallback bool ALL -resources.external_locations.*.file_event_queue *catalog.FileEventQueue ALL -resources.external_locations.*.file_event_queue.managed_aqs *catalog.AzureQueueStorage ALL -resources.external_locations.*.file_event_queue.managed_aqs.managed_resource_id string ALL -resources.external_locations.*.file_event_queue.managed_aqs.queue_url string ALL -resources.external_locations.*.file_event_queue.managed_aqs.resource_group string ALL -resources.external_locations.*.file_event_queue.managed_aqs.subscription_id string ALL -resources.external_locations.*.file_event_queue.managed_pubsub *catalog.GcpPubsub ALL -resources.external_locations.*.file_event_queue.managed_pubsub.managed_resource_id string ALL -resources.external_locations.*.file_event_queue.managed_pubsub.subscription_name string ALL -resources.external_locations.*.file_event_queue.managed_sqs *catalog.AwsSqsQueue ALL -resources.external_locations.*.file_event_queue.managed_sqs.managed_resource_id string ALL -resources.external_locations.*.file_event_queue.managed_sqs.queue_url string ALL -resources.external_locations.*.file_event_queue.provided_aqs *catalog.AzureQueueStorage ALL -resources.external_locations.*.file_event_queue.provided_aqs.managed_resource_id string ALL -resources.external_locations.*.file_event_queue.provided_aqs.queue_url string ALL -resources.external_locations.*.file_event_queue.provided_aqs.resource_group string ALL -resources.external_locations.*.file_event_queue.provided_aqs.subscription_id string ALL -resources.external_locations.*.file_event_queue.provided_pubsub *catalog.GcpPubsub ALL -resources.external_locations.*.file_event_queue.provided_pubsub.managed_resource_id string ALL -resources.external_locations.*.file_event_queue.provided_pubsub.subscription_name string ALL -resources.external_locations.*.file_event_queue.provided_sqs *catalog.AwsSqsQueue ALL -resources.external_locations.*.file_event_queue.provided_sqs.managed_resource_id string ALL -resources.external_locations.*.file_event_queue.provided_sqs.queue_url string ALL -resources.external_locations.*.id string INPUT -resources.external_locations.*.isolation_mode catalog.IsolationMode REMOTE -resources.external_locations.*.lifecycle resources.Lifecycle INPUT -resources.external_locations.*.lifecycle.prevent_destroy bool INPUT -resources.external_locations.*.metastore_id string REMOTE -resources.external_locations.*.modified_status string INPUT -resources.external_locations.*.name string ALL -resources.external_locations.*.owner string REMOTE -resources.external_locations.*.read_only bool ALL -resources.external_locations.*.skip_validation bool INPUT STATE -resources.external_locations.*.updated_at int64 REMOTE -resources.external_locations.*.updated_by string REMOTE -resources.external_locations.*.url string ALL -resources.external_locations.*.grants.full_name string ALL -resources.external_locations.*.grants.securable_type string ALL -resources.external_locations.*.grants[*] catalog.PrivilegeAssignment ALL -resources.external_locations.*.grants[*].principal string ALL -resources.external_locations.*.grants[*].privileges []catalog.Privilege ALL -resources.external_locations.*.grants[*].privileges[*] catalog.Privilege ALL -resources.jobs.*.budget_policy_id string ALL -resources.jobs.*.continuous *jobs.Continuous ALL -resources.jobs.*.continuous.pause_status jobs.PauseStatus ALL -resources.jobs.*.continuous.task_retry_mode jobs.TaskRetryMode ALL -resources.jobs.*.created_time int64 REMOTE -resources.jobs.*.creator_user_name string REMOTE -resources.jobs.*.deployment *jobs.JobDeployment ALL -resources.jobs.*.deployment.kind jobs.JobDeploymentKind ALL -resources.jobs.*.deployment.metadata_file_path string ALL -resources.jobs.*.description string ALL -resources.jobs.*.edit_mode jobs.JobEditMode ALL -resources.jobs.*.effective_budget_policy_id string REMOTE -resources.jobs.*.effective_usage_policy_id string REMOTE -resources.jobs.*.email_notifications *jobs.JobEmailNotifications ALL -resources.jobs.*.email_notifications.no_alert_for_skipped_runs bool ALL -resources.jobs.*.email_notifications.on_duration_warning_threshold_exceeded []string ALL -resources.jobs.*.email_notifications.on_duration_warning_threshold_exceeded[*] string ALL -resources.jobs.*.email_notifications.on_failure []string ALL -resources.jobs.*.email_notifications.on_failure[*] string ALL -resources.jobs.*.email_notifications.on_start []string ALL -resources.jobs.*.email_notifications.on_start[*] string ALL -resources.jobs.*.email_notifications.on_streaming_backlog_exceeded []string ALL -resources.jobs.*.email_notifications.on_streaming_backlog_exceeded[*] string ALL -resources.jobs.*.email_notifications.on_success []string ALL -resources.jobs.*.email_notifications.on_success[*] string ALL -resources.jobs.*.environments []jobs.JobEnvironment ALL -resources.jobs.*.environments[*] jobs.JobEnvironment ALL -resources.jobs.*.environments[*].environment_key string ALL -resources.jobs.*.environments[*].spec *compute.Environment ALL -resources.jobs.*.environments[*].spec.base_environment string ALL -resources.jobs.*.environments[*].spec.client string ALL -resources.jobs.*.environments[*].spec.dependencies []string ALL -resources.jobs.*.environments[*].spec.dependencies[*] string ALL -resources.jobs.*.environments[*].spec.environment_version string ALL -resources.jobs.*.environments[*].spec.java_dependencies []string ALL -resources.jobs.*.environments[*].spec.java_dependencies[*] string ALL -resources.jobs.*.format jobs.Format ALL -resources.jobs.*.git_source *jobs.GitSource ALL -resources.jobs.*.git_source.git_branch string ALL -resources.jobs.*.git_source.git_commit string ALL -resources.jobs.*.git_source.git_provider jobs.GitProvider ALL -resources.jobs.*.git_source.git_snapshot *jobs.GitSnapshot ALL -resources.jobs.*.git_source.git_snapshot.used_commit string ALL -resources.jobs.*.git_source.git_tag string ALL -resources.jobs.*.git_source.git_url string ALL -resources.jobs.*.git_source.job_source *jobs.JobSource ALL -resources.jobs.*.git_source.job_source.dirty_state jobs.JobSourceDirtyState ALL -resources.jobs.*.git_source.job_source.import_from_git_branch string ALL -resources.jobs.*.git_source.job_source.job_config_path string ALL -resources.jobs.*.git_source.sparse_checkout *jobs.SparseCheckout ALL -resources.jobs.*.git_source.sparse_checkout.patterns []string ALL -resources.jobs.*.git_source.sparse_checkout.patterns[*] string ALL -resources.jobs.*.health *jobs.JobsHealthRules ALL -resources.jobs.*.health.rules []jobs.JobsHealthRule ALL -resources.jobs.*.health.rules[*] jobs.JobsHealthRule ALL -resources.jobs.*.health.rules[*].metric jobs.JobsHealthMetric ALL -resources.jobs.*.health.rules[*].op jobs.JobsHealthOperator ALL -resources.jobs.*.health.rules[*].value int64 ALL -resources.jobs.*.id string INPUT -resources.jobs.*.job_clusters []jobs.JobCluster ALL -resources.jobs.*.job_clusters[*] jobs.JobCluster ALL -resources.jobs.*.job_clusters[*].job_cluster_key string ALL -resources.jobs.*.job_clusters[*].new_cluster compute.ClusterSpec ALL -resources.jobs.*.job_clusters[*].new_cluster.apply_policy_default_values bool ALL -resources.jobs.*.job_clusters[*].new_cluster.autoscale *compute.AutoScale ALL -resources.jobs.*.job_clusters[*].new_cluster.autoscale.max_workers int ALL -resources.jobs.*.job_clusters[*].new_cluster.autoscale.min_workers int ALL -resources.jobs.*.job_clusters[*].new_cluster.autotermination_minutes int ALL -resources.jobs.*.job_clusters[*].new_cluster.aws_attributes *compute.AwsAttributes ALL -resources.jobs.*.job_clusters[*].new_cluster.aws_attributes.availability compute.AwsAvailability ALL -resources.jobs.*.job_clusters[*].new_cluster.aws_attributes.ebs_volume_count int ALL -resources.jobs.*.job_clusters[*].new_cluster.aws_attributes.ebs_volume_iops int ALL -resources.jobs.*.job_clusters[*].new_cluster.aws_attributes.ebs_volume_size int ALL -resources.jobs.*.job_clusters[*].new_cluster.aws_attributes.ebs_volume_throughput int ALL -resources.jobs.*.job_clusters[*].new_cluster.aws_attributes.ebs_volume_type compute.EbsVolumeType ALL -resources.jobs.*.job_clusters[*].new_cluster.aws_attributes.first_on_demand int ALL -resources.jobs.*.job_clusters[*].new_cluster.aws_attributes.instance_profile_arn string ALL -resources.jobs.*.job_clusters[*].new_cluster.aws_attributes.spot_bid_price_percent int ALL -resources.jobs.*.job_clusters[*].new_cluster.aws_attributes.zone_id string ALL -resources.jobs.*.job_clusters[*].new_cluster.azure_attributes *compute.AzureAttributes ALL -resources.jobs.*.job_clusters[*].new_cluster.azure_attributes.availability compute.AzureAvailability ALL -resources.jobs.*.job_clusters[*].new_cluster.azure_attributes.first_on_demand int ALL -resources.jobs.*.job_clusters[*].new_cluster.azure_attributes.log_analytics_info *compute.LogAnalyticsInfo ALL -resources.jobs.*.job_clusters[*].new_cluster.azure_attributes.log_analytics_info.log_analytics_primary_key string ALL -resources.jobs.*.job_clusters[*].new_cluster.azure_attributes.log_analytics_info.log_analytics_workspace_id string ALL -resources.jobs.*.job_clusters[*].new_cluster.azure_attributes.spot_bid_max_price float64 ALL -resources.jobs.*.job_clusters[*].new_cluster.cluster_log_conf *compute.ClusterLogConf ALL -resources.jobs.*.job_clusters[*].new_cluster.cluster_log_conf.dbfs *compute.DbfsStorageInfo ALL -resources.jobs.*.job_clusters[*].new_cluster.cluster_log_conf.dbfs.destination string ALL -resources.jobs.*.job_clusters[*].new_cluster.cluster_log_conf.s3 *compute.S3StorageInfo ALL -resources.jobs.*.job_clusters[*].new_cluster.cluster_log_conf.s3.canned_acl string ALL -resources.jobs.*.job_clusters[*].new_cluster.cluster_log_conf.s3.destination string ALL -resources.jobs.*.job_clusters[*].new_cluster.cluster_log_conf.s3.enable_encryption bool ALL -resources.jobs.*.job_clusters[*].new_cluster.cluster_log_conf.s3.encryption_type string ALL -resources.jobs.*.job_clusters[*].new_cluster.cluster_log_conf.s3.endpoint string ALL -resources.jobs.*.job_clusters[*].new_cluster.cluster_log_conf.s3.kms_key string ALL -resources.jobs.*.job_clusters[*].new_cluster.cluster_log_conf.s3.region string ALL -resources.jobs.*.job_clusters[*].new_cluster.cluster_log_conf.volumes *compute.VolumesStorageInfo ALL -resources.jobs.*.job_clusters[*].new_cluster.cluster_log_conf.volumes.destination string ALL -resources.jobs.*.job_clusters[*].new_cluster.cluster_name string ALL -resources.jobs.*.job_clusters[*].new_cluster.custom_tags map[string]string ALL -resources.jobs.*.job_clusters[*].new_cluster.custom_tags.* string ALL -resources.jobs.*.job_clusters[*].new_cluster.data_security_mode compute.DataSecurityMode ALL -resources.jobs.*.job_clusters[*].new_cluster.docker_image *compute.DockerImage ALL -resources.jobs.*.job_clusters[*].new_cluster.docker_image.basic_auth *compute.DockerBasicAuth ALL -resources.jobs.*.job_clusters[*].new_cluster.docker_image.basic_auth.password string ALL -resources.jobs.*.job_clusters[*].new_cluster.docker_image.basic_auth.username string ALL -resources.jobs.*.job_clusters[*].new_cluster.docker_image.url string ALL -resources.jobs.*.job_clusters[*].new_cluster.driver_instance_pool_id string ALL -resources.jobs.*.job_clusters[*].new_cluster.driver_node_type_flexibility *compute.NodeTypeFlexibility ALL -resources.jobs.*.job_clusters[*].new_cluster.driver_node_type_flexibility.alternate_node_type_ids []string ALL -resources.jobs.*.job_clusters[*].new_cluster.driver_node_type_flexibility.alternate_node_type_ids[*] string ALL -resources.jobs.*.job_clusters[*].new_cluster.driver_node_type_id string ALL -resources.jobs.*.job_clusters[*].new_cluster.enable_elastic_disk bool ALL -resources.jobs.*.job_clusters[*].new_cluster.enable_local_disk_encryption bool ALL -resources.jobs.*.job_clusters[*].new_cluster.gcp_attributes *compute.GcpAttributes ALL -resources.jobs.*.job_clusters[*].new_cluster.gcp_attributes.availability compute.GcpAvailability ALL -resources.jobs.*.job_clusters[*].new_cluster.gcp_attributes.boot_disk_size int ALL -resources.jobs.*.job_clusters[*].new_cluster.gcp_attributes.confidential_compute_type compute.ConfidentialComputeType ALL -resources.jobs.*.job_clusters[*].new_cluster.gcp_attributes.first_on_demand int ALL -resources.jobs.*.job_clusters[*].new_cluster.gcp_attributes.google_service_account string ALL -resources.jobs.*.job_clusters[*].new_cluster.gcp_attributes.local_ssd_count int ALL -resources.jobs.*.job_clusters[*].new_cluster.gcp_attributes.use_preemptible_executors bool ALL -resources.jobs.*.job_clusters[*].new_cluster.gcp_attributes.zone_id string ALL -resources.jobs.*.job_clusters[*].new_cluster.init_scripts []compute.InitScriptInfo ALL -resources.jobs.*.job_clusters[*].new_cluster.init_scripts[*] compute.InitScriptInfo ALL -resources.jobs.*.job_clusters[*].new_cluster.init_scripts[*].abfss *compute.Adlsgen2Info ALL -resources.jobs.*.job_clusters[*].new_cluster.init_scripts[*].abfss.destination string ALL -resources.jobs.*.job_clusters[*].new_cluster.init_scripts[*].dbfs *compute.DbfsStorageInfo ALL -resources.jobs.*.job_clusters[*].new_cluster.init_scripts[*].dbfs.destination string ALL -resources.jobs.*.job_clusters[*].new_cluster.init_scripts[*].file *compute.LocalFileInfo ALL -resources.jobs.*.job_clusters[*].new_cluster.init_scripts[*].file.destination string ALL -resources.jobs.*.job_clusters[*].new_cluster.init_scripts[*].gcs *compute.GcsStorageInfo ALL -resources.jobs.*.job_clusters[*].new_cluster.init_scripts[*].gcs.destination string ALL -resources.jobs.*.job_clusters[*].new_cluster.init_scripts[*].s3 *compute.S3StorageInfo ALL -resources.jobs.*.job_clusters[*].new_cluster.init_scripts[*].s3.canned_acl string ALL -resources.jobs.*.job_clusters[*].new_cluster.init_scripts[*].s3.destination string ALL -resources.jobs.*.job_clusters[*].new_cluster.init_scripts[*].s3.enable_encryption bool ALL -resources.jobs.*.job_clusters[*].new_cluster.init_scripts[*].s3.encryption_type string ALL -resources.jobs.*.job_clusters[*].new_cluster.init_scripts[*].s3.endpoint string ALL -resources.jobs.*.job_clusters[*].new_cluster.init_scripts[*].s3.kms_key string ALL -resources.jobs.*.job_clusters[*].new_cluster.init_scripts[*].s3.region string ALL -resources.jobs.*.job_clusters[*].new_cluster.init_scripts[*].volumes *compute.VolumesStorageInfo ALL -resources.jobs.*.job_clusters[*].new_cluster.init_scripts[*].volumes.destination string ALL -resources.jobs.*.job_clusters[*].new_cluster.init_scripts[*].workspace *compute.WorkspaceStorageInfo ALL -resources.jobs.*.job_clusters[*].new_cluster.init_scripts[*].workspace.destination string ALL -resources.jobs.*.job_clusters[*].new_cluster.instance_pool_id string ALL -resources.jobs.*.job_clusters[*].new_cluster.is_single_node bool ALL -resources.jobs.*.job_clusters[*].new_cluster.kind compute.Kind ALL -resources.jobs.*.job_clusters[*].new_cluster.node_type_id string ALL -resources.jobs.*.job_clusters[*].new_cluster.num_workers int ALL -resources.jobs.*.job_clusters[*].new_cluster.policy_id string ALL -resources.jobs.*.job_clusters[*].new_cluster.remote_disk_throughput int ALL -resources.jobs.*.job_clusters[*].new_cluster.runtime_engine compute.RuntimeEngine ALL -resources.jobs.*.job_clusters[*].new_cluster.single_user_name string ALL -resources.jobs.*.job_clusters[*].new_cluster.spark_conf map[string]string ALL -resources.jobs.*.job_clusters[*].new_cluster.spark_conf.* string ALL -resources.jobs.*.job_clusters[*].new_cluster.spark_env_vars map[string]string ALL -resources.jobs.*.job_clusters[*].new_cluster.spark_env_vars.* string ALL -resources.jobs.*.job_clusters[*].new_cluster.spark_version string ALL -resources.jobs.*.job_clusters[*].new_cluster.ssh_public_keys []string ALL -resources.jobs.*.job_clusters[*].new_cluster.ssh_public_keys[*] string ALL -resources.jobs.*.job_clusters[*].new_cluster.total_initial_remote_disk_size int ALL -resources.jobs.*.job_clusters[*].new_cluster.use_ml_runtime bool ALL -resources.jobs.*.job_clusters[*].new_cluster.worker_node_type_flexibility *compute.NodeTypeFlexibility ALL -resources.jobs.*.job_clusters[*].new_cluster.worker_node_type_flexibility.alternate_node_type_ids []string ALL -resources.jobs.*.job_clusters[*].new_cluster.worker_node_type_flexibility.alternate_node_type_ids[*] string ALL -resources.jobs.*.job_clusters[*].new_cluster.workload_type *compute.WorkloadType ALL -resources.jobs.*.job_clusters[*].new_cluster.workload_type.clients compute.ClientsTypes ALL -resources.jobs.*.job_clusters[*].new_cluster.workload_type.clients.jobs bool ALL -resources.jobs.*.job_clusters[*].new_cluster.workload_type.clients.notebooks bool ALL -resources.jobs.*.job_id int64 REMOTE -resources.jobs.*.lifecycle resources.Lifecycle INPUT -resources.jobs.*.lifecycle.prevent_destroy bool INPUT -resources.jobs.*.max_concurrent_runs int ALL -resources.jobs.*.modified_status string INPUT -resources.jobs.*.name string ALL -resources.jobs.*.notification_settings *jobs.JobNotificationSettings ALL -resources.jobs.*.notification_settings.no_alert_for_canceled_runs bool ALL -resources.jobs.*.notification_settings.no_alert_for_skipped_runs bool ALL -resources.jobs.*.parameters []jobs.JobParameterDefinition ALL -resources.jobs.*.parameters[*] jobs.JobParameterDefinition ALL -resources.jobs.*.parameters[*].default string ALL -resources.jobs.*.parameters[*].name string ALL -resources.jobs.*.performance_target jobs.PerformanceTarget ALL -resources.jobs.*.queue *jobs.QueueSettings ALL -resources.jobs.*.queue.enabled bool ALL -resources.jobs.*.run_as *jobs.JobRunAs ALL -resources.jobs.*.run_as.group_name string ALL -resources.jobs.*.run_as.service_principal_name string ALL -resources.jobs.*.run_as.user_name string ALL -resources.jobs.*.run_as_user_name string REMOTE -resources.jobs.*.schedule *jobs.CronSchedule ALL -resources.jobs.*.schedule.pause_status jobs.PauseStatus ALL -resources.jobs.*.schedule.quartz_cron_expression string ALL -resources.jobs.*.schedule.timezone_id string ALL -resources.jobs.*.tags map[string]string ALL -resources.jobs.*.tags.* string ALL -resources.jobs.*.tasks []jobs.Task ALL -resources.jobs.*.tasks[*] jobs.Task ALL -resources.jobs.*.tasks[*].alert_task *jobs.AlertTask ALL -resources.jobs.*.tasks[*].alert_task.alert_id string ALL -resources.jobs.*.tasks[*].alert_task.subscribers []jobs.AlertTaskSubscriber ALL -resources.jobs.*.tasks[*].alert_task.subscribers[*] jobs.AlertTaskSubscriber ALL -resources.jobs.*.tasks[*].alert_task.subscribers[*].destination_id string ALL -resources.jobs.*.tasks[*].alert_task.subscribers[*].user_name string ALL -resources.jobs.*.tasks[*].alert_task.warehouse_id string ALL -resources.jobs.*.tasks[*].alert_task.workspace_path string ALL -resources.jobs.*.tasks[*].clean_rooms_notebook_task *jobs.CleanRoomsNotebookTask ALL -resources.jobs.*.tasks[*].clean_rooms_notebook_task.clean_room_name string ALL -resources.jobs.*.tasks[*].clean_rooms_notebook_task.etag string ALL -resources.jobs.*.tasks[*].clean_rooms_notebook_task.notebook_base_parameters map[string]string ALL -resources.jobs.*.tasks[*].clean_rooms_notebook_task.notebook_base_parameters.* string ALL -resources.jobs.*.tasks[*].clean_rooms_notebook_task.notebook_name string ALL -resources.jobs.*.tasks[*].compute *jobs.Compute ALL -resources.jobs.*.tasks[*].compute.hardware_accelerator compute.HardwareAcceleratorType ALL -resources.jobs.*.tasks[*].condition_task *jobs.ConditionTask ALL -resources.jobs.*.tasks[*].condition_task.left string ALL -resources.jobs.*.tasks[*].condition_task.op jobs.ConditionTaskOp ALL -resources.jobs.*.tasks[*].condition_task.right string ALL -resources.jobs.*.tasks[*].dashboard_task *jobs.DashboardTask ALL -resources.jobs.*.tasks[*].dashboard_task.dashboard_id string ALL -resources.jobs.*.tasks[*].dashboard_task.filters map[string]string ALL -resources.jobs.*.tasks[*].dashboard_task.filters.* string ALL -resources.jobs.*.tasks[*].dashboard_task.subscription *jobs.Subscription ALL -resources.jobs.*.tasks[*].dashboard_task.subscription.custom_subject string ALL -resources.jobs.*.tasks[*].dashboard_task.subscription.paused bool ALL -resources.jobs.*.tasks[*].dashboard_task.subscription.subscribers []jobs.SubscriptionSubscriber ALL -resources.jobs.*.tasks[*].dashboard_task.subscription.subscribers[*] jobs.SubscriptionSubscriber ALL -resources.jobs.*.tasks[*].dashboard_task.subscription.subscribers[*].destination_id string ALL -resources.jobs.*.tasks[*].dashboard_task.subscription.subscribers[*].user_name string ALL -resources.jobs.*.tasks[*].dashboard_task.warehouse_id string ALL -resources.jobs.*.tasks[*].dbt_cloud_task *jobs.DbtCloudTask ALL -resources.jobs.*.tasks[*].dbt_cloud_task.connection_resource_name string ALL -resources.jobs.*.tasks[*].dbt_cloud_task.dbt_cloud_job_id int64 ALL -resources.jobs.*.tasks[*].dbt_platform_task *jobs.DbtPlatformTask ALL -resources.jobs.*.tasks[*].dbt_platform_task.connection_resource_name string ALL -resources.jobs.*.tasks[*].dbt_platform_task.dbt_platform_job_id string ALL -resources.jobs.*.tasks[*].dbt_task *jobs.DbtTask ALL -resources.jobs.*.tasks[*].dbt_task.catalog string ALL -resources.jobs.*.tasks[*].dbt_task.commands []string ALL -resources.jobs.*.tasks[*].dbt_task.commands[*] string ALL -resources.jobs.*.tasks[*].dbt_task.profiles_directory string ALL -resources.jobs.*.tasks[*].dbt_task.project_directory string ALL -resources.jobs.*.tasks[*].dbt_task.schema string ALL -resources.jobs.*.tasks[*].dbt_task.source jobs.Source ALL -resources.jobs.*.tasks[*].dbt_task.warehouse_id string ALL -resources.jobs.*.tasks[*].depends_on []jobs.TaskDependency ALL -resources.jobs.*.tasks[*].depends_on[*] jobs.TaskDependency ALL -resources.jobs.*.tasks[*].depends_on[*].outcome string ALL -resources.jobs.*.tasks[*].depends_on[*].task_key string ALL -resources.jobs.*.tasks[*].description string ALL -resources.jobs.*.tasks[*].disable_auto_optimization bool ALL -resources.jobs.*.tasks[*].disabled bool ALL -resources.jobs.*.tasks[*].email_notifications *jobs.TaskEmailNotifications ALL -resources.jobs.*.tasks[*].email_notifications.no_alert_for_skipped_runs bool ALL -resources.jobs.*.tasks[*].email_notifications.on_duration_warning_threshold_exceeded []string ALL -resources.jobs.*.tasks[*].email_notifications.on_duration_warning_threshold_exceeded[*] string ALL -resources.jobs.*.tasks[*].email_notifications.on_failure []string ALL -resources.jobs.*.tasks[*].email_notifications.on_failure[*] string ALL -resources.jobs.*.tasks[*].email_notifications.on_start []string ALL -resources.jobs.*.tasks[*].email_notifications.on_start[*] string ALL -resources.jobs.*.tasks[*].email_notifications.on_streaming_backlog_exceeded []string ALL -resources.jobs.*.tasks[*].email_notifications.on_streaming_backlog_exceeded[*] string ALL -resources.jobs.*.tasks[*].email_notifications.on_success []string ALL -resources.jobs.*.tasks[*].email_notifications.on_success[*] string ALL -resources.jobs.*.tasks[*].environment_key string ALL -resources.jobs.*.tasks[*].existing_cluster_id string ALL -resources.jobs.*.tasks[*].for_each_task *jobs.ForEachTask ALL -resources.jobs.*.tasks[*].for_each_task.concurrency int ALL -resources.jobs.*.tasks[*].for_each_task.inputs string ALL -resources.jobs.*.tasks[*].for_each_task.task jobs.Task ALL -resources.jobs.*.tasks[*].for_each_task.task.alert_task *jobs.AlertTask ALL -resources.jobs.*.tasks[*].for_each_task.task.alert_task.alert_id string ALL -resources.jobs.*.tasks[*].for_each_task.task.alert_task.subscribers []jobs.AlertTaskSubscriber ALL -resources.jobs.*.tasks[*].for_each_task.task.alert_task.subscribers[*] jobs.AlertTaskSubscriber ALL -resources.jobs.*.tasks[*].for_each_task.task.alert_task.subscribers[*].destination_id string ALL -resources.jobs.*.tasks[*].for_each_task.task.alert_task.subscribers[*].user_name string ALL -resources.jobs.*.tasks[*].for_each_task.task.alert_task.warehouse_id string ALL -resources.jobs.*.tasks[*].for_each_task.task.alert_task.workspace_path string ALL -resources.jobs.*.tasks[*].for_each_task.task.clean_rooms_notebook_task *jobs.CleanRoomsNotebookTask ALL -resources.jobs.*.tasks[*].for_each_task.task.clean_rooms_notebook_task.clean_room_name string ALL -resources.jobs.*.tasks[*].for_each_task.task.clean_rooms_notebook_task.etag string ALL -resources.jobs.*.tasks[*].for_each_task.task.clean_rooms_notebook_task.notebook_base_parameters map[string]string ALL -resources.jobs.*.tasks[*].for_each_task.task.clean_rooms_notebook_task.notebook_base_parameters.* string ALL -resources.jobs.*.tasks[*].for_each_task.task.clean_rooms_notebook_task.notebook_name string ALL -resources.jobs.*.tasks[*].for_each_task.task.compute *jobs.Compute ALL -resources.jobs.*.tasks[*].for_each_task.task.compute.hardware_accelerator compute.HardwareAcceleratorType ALL -resources.jobs.*.tasks[*].for_each_task.task.condition_task *jobs.ConditionTask ALL -resources.jobs.*.tasks[*].for_each_task.task.condition_task.left string ALL -resources.jobs.*.tasks[*].for_each_task.task.condition_task.op jobs.ConditionTaskOp ALL -resources.jobs.*.tasks[*].for_each_task.task.condition_task.right string ALL -resources.jobs.*.tasks[*].for_each_task.task.dashboard_task *jobs.DashboardTask ALL -resources.jobs.*.tasks[*].for_each_task.task.dashboard_task.dashboard_id string ALL -resources.jobs.*.tasks[*].for_each_task.task.dashboard_task.filters map[string]string ALL -resources.jobs.*.tasks[*].for_each_task.task.dashboard_task.filters.* string ALL -resources.jobs.*.tasks[*].for_each_task.task.dashboard_task.subscription *jobs.Subscription ALL -resources.jobs.*.tasks[*].for_each_task.task.dashboard_task.subscription.custom_subject string ALL -resources.jobs.*.tasks[*].for_each_task.task.dashboard_task.subscription.paused bool ALL -resources.jobs.*.tasks[*].for_each_task.task.dashboard_task.subscription.subscribers []jobs.SubscriptionSubscriber ALL -resources.jobs.*.tasks[*].for_each_task.task.dashboard_task.subscription.subscribers[*] jobs.SubscriptionSubscriber ALL -resources.jobs.*.tasks[*].for_each_task.task.dashboard_task.subscription.subscribers[*].destination_id string ALL -resources.jobs.*.tasks[*].for_each_task.task.dashboard_task.subscription.subscribers[*].user_name string ALL -resources.jobs.*.tasks[*].for_each_task.task.dashboard_task.warehouse_id string ALL -resources.jobs.*.tasks[*].for_each_task.task.dbt_cloud_task *jobs.DbtCloudTask ALL -resources.jobs.*.tasks[*].for_each_task.task.dbt_cloud_task.connection_resource_name string ALL -resources.jobs.*.tasks[*].for_each_task.task.dbt_cloud_task.dbt_cloud_job_id int64 ALL -resources.jobs.*.tasks[*].for_each_task.task.dbt_platform_task *jobs.DbtPlatformTask ALL -resources.jobs.*.tasks[*].for_each_task.task.dbt_platform_task.connection_resource_name string ALL -resources.jobs.*.tasks[*].for_each_task.task.dbt_platform_task.dbt_platform_job_id string ALL -resources.jobs.*.tasks[*].for_each_task.task.dbt_task *jobs.DbtTask ALL -resources.jobs.*.tasks[*].for_each_task.task.dbt_task.catalog string ALL -resources.jobs.*.tasks[*].for_each_task.task.dbt_task.commands []string ALL -resources.jobs.*.tasks[*].for_each_task.task.dbt_task.commands[*] string ALL -resources.jobs.*.tasks[*].for_each_task.task.dbt_task.profiles_directory string ALL -resources.jobs.*.tasks[*].for_each_task.task.dbt_task.project_directory string ALL -resources.jobs.*.tasks[*].for_each_task.task.dbt_task.schema string ALL -resources.jobs.*.tasks[*].for_each_task.task.dbt_task.source jobs.Source ALL -resources.jobs.*.tasks[*].for_each_task.task.dbt_task.warehouse_id string ALL -resources.jobs.*.tasks[*].for_each_task.task.depends_on []jobs.TaskDependency ALL -resources.jobs.*.tasks[*].for_each_task.task.depends_on[*] jobs.TaskDependency ALL -resources.jobs.*.tasks[*].for_each_task.task.depends_on[*].outcome string ALL -resources.jobs.*.tasks[*].for_each_task.task.depends_on[*].task_key string ALL -resources.jobs.*.tasks[*].for_each_task.task.description string ALL -resources.jobs.*.tasks[*].for_each_task.task.disable_auto_optimization bool ALL -resources.jobs.*.tasks[*].for_each_task.task.disabled bool ALL -resources.jobs.*.tasks[*].for_each_task.task.email_notifications *jobs.TaskEmailNotifications ALL -resources.jobs.*.tasks[*].for_each_task.task.email_notifications.no_alert_for_skipped_runs bool ALL -resources.jobs.*.tasks[*].for_each_task.task.email_notifications.on_duration_warning_threshold_exceeded []string ALL -resources.jobs.*.tasks[*].for_each_task.task.email_notifications.on_duration_warning_threshold_exceeded[*] string ALL -resources.jobs.*.tasks[*].for_each_task.task.email_notifications.on_failure []string ALL -resources.jobs.*.tasks[*].for_each_task.task.email_notifications.on_failure[*] string ALL -resources.jobs.*.tasks[*].for_each_task.task.email_notifications.on_start []string ALL -resources.jobs.*.tasks[*].for_each_task.task.email_notifications.on_start[*] string ALL -resources.jobs.*.tasks[*].for_each_task.task.email_notifications.on_streaming_backlog_exceeded []string ALL -resources.jobs.*.tasks[*].for_each_task.task.email_notifications.on_streaming_backlog_exceeded[*] string ALL -resources.jobs.*.tasks[*].for_each_task.task.email_notifications.on_success []string ALL -resources.jobs.*.tasks[*].for_each_task.task.email_notifications.on_success[*] string ALL -resources.jobs.*.tasks[*].for_each_task.task.environment_key string ALL -resources.jobs.*.tasks[*].for_each_task.task.existing_cluster_id string ALL -resources.jobs.*.tasks[*].for_each_task.task.for_each_task *jobs.ForEachTask ALL -resources.jobs.*.tasks[*].for_each_task.task.for_each_task.concurrency int ALL -resources.jobs.*.tasks[*].for_each_task.task.for_each_task.inputs string ALL -resources.jobs.*.tasks[*].for_each_task.task.for_each_task.task jobs.Task ALL -resources.jobs.*.tasks[*].for_each_task.task.gen_ai_compute_task *jobs.GenAiComputeTask ALL -resources.jobs.*.tasks[*].for_each_task.task.gen_ai_compute_task.command string ALL -resources.jobs.*.tasks[*].for_each_task.task.gen_ai_compute_task.compute *jobs.ComputeConfig ALL -resources.jobs.*.tasks[*].for_each_task.task.gen_ai_compute_task.compute.gpu_node_pool_id string ALL -resources.jobs.*.tasks[*].for_each_task.task.gen_ai_compute_task.compute.gpu_type string ALL -resources.jobs.*.tasks[*].for_each_task.task.gen_ai_compute_task.compute.num_gpus int ALL -resources.jobs.*.tasks[*].for_each_task.task.gen_ai_compute_task.dl_runtime_image string ALL -resources.jobs.*.tasks[*].for_each_task.task.gen_ai_compute_task.mlflow_experiment_name string ALL -resources.jobs.*.tasks[*].for_each_task.task.gen_ai_compute_task.source jobs.Source ALL -resources.jobs.*.tasks[*].for_each_task.task.gen_ai_compute_task.training_script_path string ALL -resources.jobs.*.tasks[*].for_each_task.task.gen_ai_compute_task.yaml_parameters string ALL -resources.jobs.*.tasks[*].for_each_task.task.gen_ai_compute_task.yaml_parameters_file_path string ALL -resources.jobs.*.tasks[*].for_each_task.task.health *jobs.JobsHealthRules ALL -resources.jobs.*.tasks[*].for_each_task.task.health.rules []jobs.JobsHealthRule ALL -resources.jobs.*.tasks[*].for_each_task.task.health.rules[*] jobs.JobsHealthRule ALL -resources.jobs.*.tasks[*].for_each_task.task.health.rules[*].metric jobs.JobsHealthMetric ALL -resources.jobs.*.tasks[*].for_each_task.task.health.rules[*].op jobs.JobsHealthOperator ALL -resources.jobs.*.tasks[*].for_each_task.task.health.rules[*].value int64 ALL -resources.jobs.*.tasks[*].for_each_task.task.job_cluster_key string ALL -resources.jobs.*.tasks[*].for_each_task.task.libraries []compute.Library ALL -resources.jobs.*.tasks[*].for_each_task.task.libraries[*] compute.Library ALL -resources.jobs.*.tasks[*].for_each_task.task.libraries[*].cran *compute.RCranLibrary ALL -resources.jobs.*.tasks[*].for_each_task.task.libraries[*].cran.package string ALL -resources.jobs.*.tasks[*].for_each_task.task.libraries[*].cran.repo string ALL -resources.jobs.*.tasks[*].for_each_task.task.libraries[*].egg string ALL -resources.jobs.*.tasks[*].for_each_task.task.libraries[*].jar string ALL -resources.jobs.*.tasks[*].for_each_task.task.libraries[*].maven *compute.MavenLibrary ALL -resources.jobs.*.tasks[*].for_each_task.task.libraries[*].maven.coordinates string ALL -resources.jobs.*.tasks[*].for_each_task.task.libraries[*].maven.exclusions []string ALL -resources.jobs.*.tasks[*].for_each_task.task.libraries[*].maven.exclusions[*] string ALL -resources.jobs.*.tasks[*].for_each_task.task.libraries[*].maven.repo string ALL -resources.jobs.*.tasks[*].for_each_task.task.libraries[*].pypi *compute.PythonPyPiLibrary ALL -resources.jobs.*.tasks[*].for_each_task.task.libraries[*].pypi.package string ALL -resources.jobs.*.tasks[*].for_each_task.task.libraries[*].pypi.repo string ALL -resources.jobs.*.tasks[*].for_each_task.task.libraries[*].requirements string ALL -resources.jobs.*.tasks[*].for_each_task.task.libraries[*].whl string ALL -resources.jobs.*.tasks[*].for_each_task.task.max_retries int ALL -resources.jobs.*.tasks[*].for_each_task.task.min_retry_interval_millis int ALL -resources.jobs.*.tasks[*].for_each_task.task.new_cluster *compute.ClusterSpec ALL -resources.jobs.*.tasks[*].for_each_task.task.new_cluster.apply_policy_default_values bool ALL -resources.jobs.*.tasks[*].for_each_task.task.new_cluster.autoscale *compute.AutoScale ALL -resources.jobs.*.tasks[*].for_each_task.task.new_cluster.autoscale.max_workers int ALL -resources.jobs.*.tasks[*].for_each_task.task.new_cluster.autoscale.min_workers int ALL -resources.jobs.*.tasks[*].for_each_task.task.new_cluster.autotermination_minutes int ALL -resources.jobs.*.tasks[*].for_each_task.task.new_cluster.aws_attributes *compute.AwsAttributes ALL -resources.jobs.*.tasks[*].for_each_task.task.new_cluster.aws_attributes.availability compute.AwsAvailability ALL -resources.jobs.*.tasks[*].for_each_task.task.new_cluster.aws_attributes.ebs_volume_count int ALL -resources.jobs.*.tasks[*].for_each_task.task.new_cluster.aws_attributes.ebs_volume_iops int ALL -resources.jobs.*.tasks[*].for_each_task.task.new_cluster.aws_attributes.ebs_volume_size int ALL -resources.jobs.*.tasks[*].for_each_task.task.new_cluster.aws_attributes.ebs_volume_throughput int ALL -resources.jobs.*.tasks[*].for_each_task.task.new_cluster.aws_attributes.ebs_volume_type compute.EbsVolumeType ALL -resources.jobs.*.tasks[*].for_each_task.task.new_cluster.aws_attributes.first_on_demand int ALL -resources.jobs.*.tasks[*].for_each_task.task.new_cluster.aws_attributes.instance_profile_arn string ALL -resources.jobs.*.tasks[*].for_each_task.task.new_cluster.aws_attributes.spot_bid_price_percent int ALL -resources.jobs.*.tasks[*].for_each_task.task.new_cluster.aws_attributes.zone_id string ALL -resources.jobs.*.tasks[*].for_each_task.task.new_cluster.azure_attributes *compute.AzureAttributes ALL -resources.jobs.*.tasks[*].for_each_task.task.new_cluster.azure_attributes.availability compute.AzureAvailability ALL -resources.jobs.*.tasks[*].for_each_task.task.new_cluster.azure_attributes.first_on_demand int ALL -resources.jobs.*.tasks[*].for_each_task.task.new_cluster.azure_attributes.log_analytics_info *compute.LogAnalyticsInfo ALL -resources.jobs.*.tasks[*].for_each_task.task.new_cluster.azure_attributes.log_analytics_info.log_analytics_primary_key string ALL -resources.jobs.*.tasks[*].for_each_task.task.new_cluster.azure_attributes.log_analytics_info.log_analytics_workspace_id string ALL -resources.jobs.*.tasks[*].for_each_task.task.new_cluster.azure_attributes.spot_bid_max_price float64 ALL -resources.jobs.*.tasks[*].for_each_task.task.new_cluster.cluster_log_conf *compute.ClusterLogConf ALL -resources.jobs.*.tasks[*].for_each_task.task.new_cluster.cluster_log_conf.dbfs *compute.DbfsStorageInfo ALL -resources.jobs.*.tasks[*].for_each_task.task.new_cluster.cluster_log_conf.dbfs.destination string ALL -resources.jobs.*.tasks[*].for_each_task.task.new_cluster.cluster_log_conf.s3 *compute.S3StorageInfo ALL -resources.jobs.*.tasks[*].for_each_task.task.new_cluster.cluster_log_conf.s3.canned_acl string ALL -resources.jobs.*.tasks[*].for_each_task.task.new_cluster.cluster_log_conf.s3.destination string ALL -resources.jobs.*.tasks[*].for_each_task.task.new_cluster.cluster_log_conf.s3.enable_encryption bool ALL -resources.jobs.*.tasks[*].for_each_task.task.new_cluster.cluster_log_conf.s3.encryption_type string ALL -resources.jobs.*.tasks[*].for_each_task.task.new_cluster.cluster_log_conf.s3.endpoint string ALL -resources.jobs.*.tasks[*].for_each_task.task.new_cluster.cluster_log_conf.s3.kms_key string ALL -resources.jobs.*.tasks[*].for_each_task.task.new_cluster.cluster_log_conf.s3.region string ALL -resources.jobs.*.tasks[*].for_each_task.task.new_cluster.cluster_log_conf.volumes *compute.VolumesStorageInfo ALL -resources.jobs.*.tasks[*].for_each_task.task.new_cluster.cluster_log_conf.volumes.destination string ALL -resources.jobs.*.tasks[*].for_each_task.task.new_cluster.cluster_name string ALL -resources.jobs.*.tasks[*].for_each_task.task.new_cluster.custom_tags map[string]string ALL -resources.jobs.*.tasks[*].for_each_task.task.new_cluster.custom_tags.* string ALL -resources.jobs.*.tasks[*].for_each_task.task.new_cluster.data_security_mode compute.DataSecurityMode ALL -resources.jobs.*.tasks[*].for_each_task.task.new_cluster.docker_image *compute.DockerImage ALL -resources.jobs.*.tasks[*].for_each_task.task.new_cluster.docker_image.basic_auth *compute.DockerBasicAuth ALL -resources.jobs.*.tasks[*].for_each_task.task.new_cluster.docker_image.basic_auth.password string ALL -resources.jobs.*.tasks[*].for_each_task.task.new_cluster.docker_image.basic_auth.username string ALL -resources.jobs.*.tasks[*].for_each_task.task.new_cluster.docker_image.url string ALL -resources.jobs.*.tasks[*].for_each_task.task.new_cluster.driver_instance_pool_id string ALL -resources.jobs.*.tasks[*].for_each_task.task.new_cluster.driver_node_type_flexibility *compute.NodeTypeFlexibility ALL -resources.jobs.*.tasks[*].for_each_task.task.new_cluster.driver_node_type_flexibility.alternate_node_type_ids []string ALL -resources.jobs.*.tasks[*].for_each_task.task.new_cluster.driver_node_type_flexibility.alternate_node_type_ids[*] string ALL -resources.jobs.*.tasks[*].for_each_task.task.new_cluster.driver_node_type_id string ALL -resources.jobs.*.tasks[*].for_each_task.task.new_cluster.enable_elastic_disk bool ALL -resources.jobs.*.tasks[*].for_each_task.task.new_cluster.enable_local_disk_encryption bool ALL -resources.jobs.*.tasks[*].for_each_task.task.new_cluster.gcp_attributes *compute.GcpAttributes ALL -resources.jobs.*.tasks[*].for_each_task.task.new_cluster.gcp_attributes.availability compute.GcpAvailability ALL -resources.jobs.*.tasks[*].for_each_task.task.new_cluster.gcp_attributes.boot_disk_size int ALL -resources.jobs.*.tasks[*].for_each_task.task.new_cluster.gcp_attributes.confidential_compute_type compute.ConfidentialComputeType ALL -resources.jobs.*.tasks[*].for_each_task.task.new_cluster.gcp_attributes.first_on_demand int ALL -resources.jobs.*.tasks[*].for_each_task.task.new_cluster.gcp_attributes.google_service_account string ALL -resources.jobs.*.tasks[*].for_each_task.task.new_cluster.gcp_attributes.local_ssd_count int ALL -resources.jobs.*.tasks[*].for_each_task.task.new_cluster.gcp_attributes.use_preemptible_executors bool ALL -resources.jobs.*.tasks[*].for_each_task.task.new_cluster.gcp_attributes.zone_id string ALL -resources.jobs.*.tasks[*].for_each_task.task.new_cluster.init_scripts []compute.InitScriptInfo ALL -resources.jobs.*.tasks[*].for_each_task.task.new_cluster.init_scripts[*] compute.InitScriptInfo ALL -resources.jobs.*.tasks[*].for_each_task.task.new_cluster.init_scripts[*].abfss *compute.Adlsgen2Info ALL -resources.jobs.*.tasks[*].for_each_task.task.new_cluster.init_scripts[*].abfss.destination string ALL -resources.jobs.*.tasks[*].for_each_task.task.new_cluster.init_scripts[*].dbfs *compute.DbfsStorageInfo ALL -resources.jobs.*.tasks[*].for_each_task.task.new_cluster.init_scripts[*].dbfs.destination string ALL -resources.jobs.*.tasks[*].for_each_task.task.new_cluster.init_scripts[*].file *compute.LocalFileInfo ALL -resources.jobs.*.tasks[*].for_each_task.task.new_cluster.init_scripts[*].file.destination string ALL -resources.jobs.*.tasks[*].for_each_task.task.new_cluster.init_scripts[*].gcs *compute.GcsStorageInfo ALL -resources.jobs.*.tasks[*].for_each_task.task.new_cluster.init_scripts[*].gcs.destination string ALL -resources.jobs.*.tasks[*].for_each_task.task.new_cluster.init_scripts[*].s3 *compute.S3StorageInfo ALL -resources.jobs.*.tasks[*].for_each_task.task.new_cluster.init_scripts[*].s3.canned_acl string ALL -resources.jobs.*.tasks[*].for_each_task.task.new_cluster.init_scripts[*].s3.destination string ALL -resources.jobs.*.tasks[*].for_each_task.task.new_cluster.init_scripts[*].s3.enable_encryption bool ALL -resources.jobs.*.tasks[*].for_each_task.task.new_cluster.init_scripts[*].s3.encryption_type string ALL -resources.jobs.*.tasks[*].for_each_task.task.new_cluster.init_scripts[*].s3.endpoint string ALL -resources.jobs.*.tasks[*].for_each_task.task.new_cluster.init_scripts[*].s3.kms_key string ALL -resources.jobs.*.tasks[*].for_each_task.task.new_cluster.init_scripts[*].s3.region string ALL -resources.jobs.*.tasks[*].for_each_task.task.new_cluster.init_scripts[*].volumes *compute.VolumesStorageInfo ALL -resources.jobs.*.tasks[*].for_each_task.task.new_cluster.init_scripts[*].volumes.destination string ALL -resources.jobs.*.tasks[*].for_each_task.task.new_cluster.init_scripts[*].workspace *compute.WorkspaceStorageInfo ALL -resources.jobs.*.tasks[*].for_each_task.task.new_cluster.init_scripts[*].workspace.destination string ALL -resources.jobs.*.tasks[*].for_each_task.task.new_cluster.instance_pool_id string ALL -resources.jobs.*.tasks[*].for_each_task.task.new_cluster.is_single_node bool ALL -resources.jobs.*.tasks[*].for_each_task.task.new_cluster.kind compute.Kind ALL -resources.jobs.*.tasks[*].for_each_task.task.new_cluster.node_type_id string ALL -resources.jobs.*.tasks[*].for_each_task.task.new_cluster.num_workers int ALL -resources.jobs.*.tasks[*].for_each_task.task.new_cluster.policy_id string ALL -resources.jobs.*.tasks[*].for_each_task.task.new_cluster.remote_disk_throughput int ALL -resources.jobs.*.tasks[*].for_each_task.task.new_cluster.runtime_engine compute.RuntimeEngine ALL -resources.jobs.*.tasks[*].for_each_task.task.new_cluster.single_user_name string ALL -resources.jobs.*.tasks[*].for_each_task.task.new_cluster.spark_conf map[string]string ALL -resources.jobs.*.tasks[*].for_each_task.task.new_cluster.spark_conf.* string ALL -resources.jobs.*.tasks[*].for_each_task.task.new_cluster.spark_env_vars map[string]string ALL -resources.jobs.*.tasks[*].for_each_task.task.new_cluster.spark_env_vars.* string ALL -resources.jobs.*.tasks[*].for_each_task.task.new_cluster.spark_version string ALL -resources.jobs.*.tasks[*].for_each_task.task.new_cluster.ssh_public_keys []string ALL -resources.jobs.*.tasks[*].for_each_task.task.new_cluster.ssh_public_keys[*] string ALL -resources.jobs.*.tasks[*].for_each_task.task.new_cluster.total_initial_remote_disk_size int ALL -resources.jobs.*.tasks[*].for_each_task.task.new_cluster.use_ml_runtime bool ALL -resources.jobs.*.tasks[*].for_each_task.task.new_cluster.worker_node_type_flexibility *compute.NodeTypeFlexibility ALL -resources.jobs.*.tasks[*].for_each_task.task.new_cluster.worker_node_type_flexibility.alternate_node_type_ids []string ALL -resources.jobs.*.tasks[*].for_each_task.task.new_cluster.worker_node_type_flexibility.alternate_node_type_ids[*] string ALL -resources.jobs.*.tasks[*].for_each_task.task.new_cluster.workload_type *compute.WorkloadType ALL -resources.jobs.*.tasks[*].for_each_task.task.new_cluster.workload_type.clients compute.ClientsTypes ALL -resources.jobs.*.tasks[*].for_each_task.task.new_cluster.workload_type.clients.jobs bool ALL -resources.jobs.*.tasks[*].for_each_task.task.new_cluster.workload_type.clients.notebooks bool ALL -resources.jobs.*.tasks[*].for_each_task.task.notebook_task *jobs.NotebookTask ALL -resources.jobs.*.tasks[*].for_each_task.task.notebook_task.base_parameters map[string]string ALL -resources.jobs.*.tasks[*].for_each_task.task.notebook_task.base_parameters.* string ALL -resources.jobs.*.tasks[*].for_each_task.task.notebook_task.notebook_path string ALL -resources.jobs.*.tasks[*].for_each_task.task.notebook_task.source jobs.Source ALL -resources.jobs.*.tasks[*].for_each_task.task.notebook_task.warehouse_id string ALL -resources.jobs.*.tasks[*].for_each_task.task.notification_settings *jobs.TaskNotificationSettings ALL -resources.jobs.*.tasks[*].for_each_task.task.notification_settings.alert_on_last_attempt bool ALL -resources.jobs.*.tasks[*].for_each_task.task.notification_settings.no_alert_for_canceled_runs bool ALL -resources.jobs.*.tasks[*].for_each_task.task.notification_settings.no_alert_for_skipped_runs bool ALL -resources.jobs.*.tasks[*].for_each_task.task.pipeline_task *jobs.PipelineTask ALL -resources.jobs.*.tasks[*].for_each_task.task.pipeline_task.full_refresh bool ALL -resources.jobs.*.tasks[*].for_each_task.task.pipeline_task.pipeline_id string ALL -resources.jobs.*.tasks[*].for_each_task.task.power_bi_task *jobs.PowerBiTask ALL -resources.jobs.*.tasks[*].for_each_task.task.power_bi_task.connection_resource_name string ALL -resources.jobs.*.tasks[*].for_each_task.task.power_bi_task.power_bi_model *jobs.PowerBiModel ALL -resources.jobs.*.tasks[*].for_each_task.task.power_bi_task.power_bi_model.authentication_method jobs.AuthenticationMethod ALL -resources.jobs.*.tasks[*].for_each_task.task.power_bi_task.power_bi_model.model_name string ALL -resources.jobs.*.tasks[*].for_each_task.task.power_bi_task.power_bi_model.overwrite_existing bool ALL -resources.jobs.*.tasks[*].for_each_task.task.power_bi_task.power_bi_model.storage_mode jobs.StorageMode ALL -resources.jobs.*.tasks[*].for_each_task.task.power_bi_task.power_bi_model.workspace_name string ALL -resources.jobs.*.tasks[*].for_each_task.task.power_bi_task.refresh_after_update bool ALL -resources.jobs.*.tasks[*].for_each_task.task.power_bi_task.tables []jobs.PowerBiTable ALL -resources.jobs.*.tasks[*].for_each_task.task.power_bi_task.tables[*] jobs.PowerBiTable ALL -resources.jobs.*.tasks[*].for_each_task.task.power_bi_task.tables[*].catalog string ALL -resources.jobs.*.tasks[*].for_each_task.task.power_bi_task.tables[*].name string ALL -resources.jobs.*.tasks[*].for_each_task.task.power_bi_task.tables[*].schema string ALL -resources.jobs.*.tasks[*].for_each_task.task.power_bi_task.tables[*].storage_mode jobs.StorageMode ALL -resources.jobs.*.tasks[*].for_each_task.task.power_bi_task.warehouse_id string ALL -resources.jobs.*.tasks[*].for_each_task.task.python_wheel_task *jobs.PythonWheelTask ALL -resources.jobs.*.tasks[*].for_each_task.task.python_wheel_task.entry_point string ALL -resources.jobs.*.tasks[*].for_each_task.task.python_wheel_task.named_parameters map[string]string ALL -resources.jobs.*.tasks[*].for_each_task.task.python_wheel_task.named_parameters.* string ALL -resources.jobs.*.tasks[*].for_each_task.task.python_wheel_task.package_name string ALL -resources.jobs.*.tasks[*].for_each_task.task.python_wheel_task.parameters []string ALL -resources.jobs.*.tasks[*].for_each_task.task.python_wheel_task.parameters[*] string ALL -resources.jobs.*.tasks[*].for_each_task.task.retry_on_timeout bool ALL -resources.jobs.*.tasks[*].for_each_task.task.run_if jobs.RunIf ALL -resources.jobs.*.tasks[*].for_each_task.task.run_job_task *jobs.RunJobTask ALL -resources.jobs.*.tasks[*].for_each_task.task.run_job_task.dbt_commands []string ALL -resources.jobs.*.tasks[*].for_each_task.task.run_job_task.dbt_commands[*] string ALL -resources.jobs.*.tasks[*].for_each_task.task.run_job_task.jar_params []string ALL -resources.jobs.*.tasks[*].for_each_task.task.run_job_task.jar_params[*] string ALL -resources.jobs.*.tasks[*].for_each_task.task.run_job_task.job_id int64 ALL -resources.jobs.*.tasks[*].for_each_task.task.run_job_task.job_parameters map[string]string ALL -resources.jobs.*.tasks[*].for_each_task.task.run_job_task.job_parameters.* string ALL -resources.jobs.*.tasks[*].for_each_task.task.run_job_task.notebook_params map[string]string ALL -resources.jobs.*.tasks[*].for_each_task.task.run_job_task.notebook_params.* string ALL -resources.jobs.*.tasks[*].for_each_task.task.run_job_task.pipeline_params *jobs.PipelineParams ALL -resources.jobs.*.tasks[*].for_each_task.task.run_job_task.pipeline_params.full_refresh bool ALL -resources.jobs.*.tasks[*].for_each_task.task.run_job_task.python_named_params map[string]string ALL -resources.jobs.*.tasks[*].for_each_task.task.run_job_task.python_named_params.* string ALL -resources.jobs.*.tasks[*].for_each_task.task.run_job_task.python_params []string ALL -resources.jobs.*.tasks[*].for_each_task.task.run_job_task.python_params[*] string ALL -resources.jobs.*.tasks[*].for_each_task.task.run_job_task.spark_submit_params []string ALL -resources.jobs.*.tasks[*].for_each_task.task.run_job_task.spark_submit_params[*] string ALL -resources.jobs.*.tasks[*].for_each_task.task.run_job_task.sql_params map[string]string ALL -resources.jobs.*.tasks[*].for_each_task.task.run_job_task.sql_params.* string ALL -resources.jobs.*.tasks[*].for_each_task.task.spark_jar_task *jobs.SparkJarTask ALL -resources.jobs.*.tasks[*].for_each_task.task.spark_jar_task.jar_uri string ALL -resources.jobs.*.tasks[*].for_each_task.task.spark_jar_task.main_class_name string ALL -resources.jobs.*.tasks[*].for_each_task.task.spark_jar_task.parameters []string ALL -resources.jobs.*.tasks[*].for_each_task.task.spark_jar_task.parameters[*] string ALL -resources.jobs.*.tasks[*].for_each_task.task.spark_jar_task.run_as_repl bool ALL -resources.jobs.*.tasks[*].for_each_task.task.spark_python_task *jobs.SparkPythonTask ALL -resources.jobs.*.tasks[*].for_each_task.task.spark_python_task.parameters []string ALL -resources.jobs.*.tasks[*].for_each_task.task.spark_python_task.parameters[*] string ALL -resources.jobs.*.tasks[*].for_each_task.task.spark_python_task.python_file string ALL -resources.jobs.*.tasks[*].for_each_task.task.spark_python_task.source jobs.Source ALL -resources.jobs.*.tasks[*].for_each_task.task.spark_submit_task *jobs.SparkSubmitTask ALL -resources.jobs.*.tasks[*].for_each_task.task.spark_submit_task.parameters []string ALL -resources.jobs.*.tasks[*].for_each_task.task.spark_submit_task.parameters[*] string ALL -resources.jobs.*.tasks[*].for_each_task.task.sql_task *jobs.SqlTask ALL -resources.jobs.*.tasks[*].for_each_task.task.sql_task.alert *jobs.SqlTaskAlert ALL -resources.jobs.*.tasks[*].for_each_task.task.sql_task.alert.alert_id string ALL -resources.jobs.*.tasks[*].for_each_task.task.sql_task.alert.pause_subscriptions bool ALL -resources.jobs.*.tasks[*].for_each_task.task.sql_task.alert.subscriptions []jobs.SqlTaskSubscription ALL -resources.jobs.*.tasks[*].for_each_task.task.sql_task.alert.subscriptions[*] jobs.SqlTaskSubscription ALL -resources.jobs.*.tasks[*].for_each_task.task.sql_task.alert.subscriptions[*].destination_id string ALL -resources.jobs.*.tasks[*].for_each_task.task.sql_task.alert.subscriptions[*].user_name string ALL -resources.jobs.*.tasks[*].for_each_task.task.sql_task.dashboard *jobs.SqlTaskDashboard ALL -resources.jobs.*.tasks[*].for_each_task.task.sql_task.dashboard.custom_subject string ALL -resources.jobs.*.tasks[*].for_each_task.task.sql_task.dashboard.dashboard_id string ALL -resources.jobs.*.tasks[*].for_each_task.task.sql_task.dashboard.pause_subscriptions bool ALL -resources.jobs.*.tasks[*].for_each_task.task.sql_task.dashboard.subscriptions []jobs.SqlTaskSubscription ALL -resources.jobs.*.tasks[*].for_each_task.task.sql_task.dashboard.subscriptions[*] jobs.SqlTaskSubscription ALL -resources.jobs.*.tasks[*].for_each_task.task.sql_task.dashboard.subscriptions[*].destination_id string ALL -resources.jobs.*.tasks[*].for_each_task.task.sql_task.dashboard.subscriptions[*].user_name string ALL -resources.jobs.*.tasks[*].for_each_task.task.sql_task.file *jobs.SqlTaskFile ALL -resources.jobs.*.tasks[*].for_each_task.task.sql_task.file.path string ALL -resources.jobs.*.tasks[*].for_each_task.task.sql_task.file.source jobs.Source ALL -resources.jobs.*.tasks[*].for_each_task.task.sql_task.parameters map[string]string ALL -resources.jobs.*.tasks[*].for_each_task.task.sql_task.parameters.* string ALL -resources.jobs.*.tasks[*].for_each_task.task.sql_task.query *jobs.SqlTaskQuery ALL -resources.jobs.*.tasks[*].for_each_task.task.sql_task.query.query_id string ALL -resources.jobs.*.tasks[*].for_each_task.task.sql_task.warehouse_id string ALL -resources.jobs.*.tasks[*].for_each_task.task.task_key string ALL -resources.jobs.*.tasks[*].for_each_task.task.timeout_seconds int ALL -resources.jobs.*.tasks[*].for_each_task.task.webhook_notifications *jobs.WebhookNotifications ALL -resources.jobs.*.tasks[*].for_each_task.task.webhook_notifications.on_duration_warning_threshold_exceeded []jobs.Webhook ALL -resources.jobs.*.tasks[*].for_each_task.task.webhook_notifications.on_duration_warning_threshold_exceeded[*] jobs.Webhook ALL -resources.jobs.*.tasks[*].for_each_task.task.webhook_notifications.on_duration_warning_threshold_exceeded[*].id string ALL -resources.jobs.*.tasks[*].for_each_task.task.webhook_notifications.on_failure []jobs.Webhook ALL -resources.jobs.*.tasks[*].for_each_task.task.webhook_notifications.on_failure[*] jobs.Webhook ALL -resources.jobs.*.tasks[*].for_each_task.task.webhook_notifications.on_failure[*].id string ALL -resources.jobs.*.tasks[*].for_each_task.task.webhook_notifications.on_start []jobs.Webhook ALL -resources.jobs.*.tasks[*].for_each_task.task.webhook_notifications.on_start[*] jobs.Webhook ALL -resources.jobs.*.tasks[*].for_each_task.task.webhook_notifications.on_start[*].id string ALL -resources.jobs.*.tasks[*].for_each_task.task.webhook_notifications.on_streaming_backlog_exceeded []jobs.Webhook ALL -resources.jobs.*.tasks[*].for_each_task.task.webhook_notifications.on_streaming_backlog_exceeded[*] jobs.Webhook ALL -resources.jobs.*.tasks[*].for_each_task.task.webhook_notifications.on_streaming_backlog_exceeded[*].id string ALL -resources.jobs.*.tasks[*].for_each_task.task.webhook_notifications.on_success []jobs.Webhook ALL -resources.jobs.*.tasks[*].for_each_task.task.webhook_notifications.on_success[*] jobs.Webhook ALL -resources.jobs.*.tasks[*].for_each_task.task.webhook_notifications.on_success[*].id string ALL -resources.jobs.*.tasks[*].gen_ai_compute_task *jobs.GenAiComputeTask ALL -resources.jobs.*.tasks[*].gen_ai_compute_task.command string ALL -resources.jobs.*.tasks[*].gen_ai_compute_task.compute *jobs.ComputeConfig ALL -resources.jobs.*.tasks[*].gen_ai_compute_task.compute.gpu_node_pool_id string ALL -resources.jobs.*.tasks[*].gen_ai_compute_task.compute.gpu_type string ALL -resources.jobs.*.tasks[*].gen_ai_compute_task.compute.num_gpus int ALL -resources.jobs.*.tasks[*].gen_ai_compute_task.dl_runtime_image string ALL -resources.jobs.*.tasks[*].gen_ai_compute_task.mlflow_experiment_name string ALL -resources.jobs.*.tasks[*].gen_ai_compute_task.source jobs.Source ALL -resources.jobs.*.tasks[*].gen_ai_compute_task.training_script_path string ALL -resources.jobs.*.tasks[*].gen_ai_compute_task.yaml_parameters string ALL -resources.jobs.*.tasks[*].gen_ai_compute_task.yaml_parameters_file_path string ALL -resources.jobs.*.tasks[*].health *jobs.JobsHealthRules ALL -resources.jobs.*.tasks[*].health.rules []jobs.JobsHealthRule ALL -resources.jobs.*.tasks[*].health.rules[*] jobs.JobsHealthRule ALL -resources.jobs.*.tasks[*].health.rules[*].metric jobs.JobsHealthMetric ALL -resources.jobs.*.tasks[*].health.rules[*].op jobs.JobsHealthOperator ALL -resources.jobs.*.tasks[*].health.rules[*].value int64 ALL -resources.jobs.*.tasks[*].job_cluster_key string ALL -resources.jobs.*.tasks[*].libraries []compute.Library ALL -resources.jobs.*.tasks[*].libraries[*] compute.Library ALL -resources.jobs.*.tasks[*].libraries[*].cran *compute.RCranLibrary ALL -resources.jobs.*.tasks[*].libraries[*].cran.package string ALL -resources.jobs.*.tasks[*].libraries[*].cran.repo string ALL -resources.jobs.*.tasks[*].libraries[*].egg string ALL -resources.jobs.*.tasks[*].libraries[*].jar string ALL -resources.jobs.*.tasks[*].libraries[*].maven *compute.MavenLibrary ALL -resources.jobs.*.tasks[*].libraries[*].maven.coordinates string ALL -resources.jobs.*.tasks[*].libraries[*].maven.exclusions []string ALL -resources.jobs.*.tasks[*].libraries[*].maven.exclusions[*] string ALL -resources.jobs.*.tasks[*].libraries[*].maven.repo string ALL -resources.jobs.*.tasks[*].libraries[*].pypi *compute.PythonPyPiLibrary ALL -resources.jobs.*.tasks[*].libraries[*].pypi.package string ALL -resources.jobs.*.tasks[*].libraries[*].pypi.repo string ALL -resources.jobs.*.tasks[*].libraries[*].requirements string ALL -resources.jobs.*.tasks[*].libraries[*].whl string ALL -resources.jobs.*.tasks[*].max_retries int ALL -resources.jobs.*.tasks[*].min_retry_interval_millis int ALL -resources.jobs.*.tasks[*].new_cluster *compute.ClusterSpec ALL -resources.jobs.*.tasks[*].new_cluster.apply_policy_default_values bool ALL -resources.jobs.*.tasks[*].new_cluster.autoscale *compute.AutoScale ALL -resources.jobs.*.tasks[*].new_cluster.autoscale.max_workers int ALL -resources.jobs.*.tasks[*].new_cluster.autoscale.min_workers int ALL -resources.jobs.*.tasks[*].new_cluster.autotermination_minutes int ALL -resources.jobs.*.tasks[*].new_cluster.aws_attributes *compute.AwsAttributes ALL -resources.jobs.*.tasks[*].new_cluster.aws_attributes.availability compute.AwsAvailability ALL -resources.jobs.*.tasks[*].new_cluster.aws_attributes.ebs_volume_count int ALL -resources.jobs.*.tasks[*].new_cluster.aws_attributes.ebs_volume_iops int ALL -resources.jobs.*.tasks[*].new_cluster.aws_attributes.ebs_volume_size int ALL -resources.jobs.*.tasks[*].new_cluster.aws_attributes.ebs_volume_throughput int ALL -resources.jobs.*.tasks[*].new_cluster.aws_attributes.ebs_volume_type compute.EbsVolumeType ALL -resources.jobs.*.tasks[*].new_cluster.aws_attributes.first_on_demand int ALL -resources.jobs.*.tasks[*].new_cluster.aws_attributes.instance_profile_arn string ALL -resources.jobs.*.tasks[*].new_cluster.aws_attributes.spot_bid_price_percent int ALL -resources.jobs.*.tasks[*].new_cluster.aws_attributes.zone_id string ALL -resources.jobs.*.tasks[*].new_cluster.azure_attributes *compute.AzureAttributes ALL -resources.jobs.*.tasks[*].new_cluster.azure_attributes.availability compute.AzureAvailability ALL -resources.jobs.*.tasks[*].new_cluster.azure_attributes.first_on_demand int ALL -resources.jobs.*.tasks[*].new_cluster.azure_attributes.log_analytics_info *compute.LogAnalyticsInfo ALL -resources.jobs.*.tasks[*].new_cluster.azure_attributes.log_analytics_info.log_analytics_primary_key string ALL -resources.jobs.*.tasks[*].new_cluster.azure_attributes.log_analytics_info.log_analytics_workspace_id string ALL -resources.jobs.*.tasks[*].new_cluster.azure_attributes.spot_bid_max_price float64 ALL -resources.jobs.*.tasks[*].new_cluster.cluster_log_conf *compute.ClusterLogConf ALL -resources.jobs.*.tasks[*].new_cluster.cluster_log_conf.dbfs *compute.DbfsStorageInfo ALL -resources.jobs.*.tasks[*].new_cluster.cluster_log_conf.dbfs.destination string ALL -resources.jobs.*.tasks[*].new_cluster.cluster_log_conf.s3 *compute.S3StorageInfo ALL -resources.jobs.*.tasks[*].new_cluster.cluster_log_conf.s3.canned_acl string ALL -resources.jobs.*.tasks[*].new_cluster.cluster_log_conf.s3.destination string ALL -resources.jobs.*.tasks[*].new_cluster.cluster_log_conf.s3.enable_encryption bool ALL -resources.jobs.*.tasks[*].new_cluster.cluster_log_conf.s3.encryption_type string ALL -resources.jobs.*.tasks[*].new_cluster.cluster_log_conf.s3.endpoint string ALL -resources.jobs.*.tasks[*].new_cluster.cluster_log_conf.s3.kms_key string ALL -resources.jobs.*.tasks[*].new_cluster.cluster_log_conf.s3.region string ALL -resources.jobs.*.tasks[*].new_cluster.cluster_log_conf.volumes *compute.VolumesStorageInfo ALL -resources.jobs.*.tasks[*].new_cluster.cluster_log_conf.volumes.destination string ALL -resources.jobs.*.tasks[*].new_cluster.cluster_name string ALL -resources.jobs.*.tasks[*].new_cluster.custom_tags map[string]string ALL -resources.jobs.*.tasks[*].new_cluster.custom_tags.* string ALL -resources.jobs.*.tasks[*].new_cluster.data_security_mode compute.DataSecurityMode ALL -resources.jobs.*.tasks[*].new_cluster.docker_image *compute.DockerImage ALL -resources.jobs.*.tasks[*].new_cluster.docker_image.basic_auth *compute.DockerBasicAuth ALL -resources.jobs.*.tasks[*].new_cluster.docker_image.basic_auth.password string ALL -resources.jobs.*.tasks[*].new_cluster.docker_image.basic_auth.username string ALL -resources.jobs.*.tasks[*].new_cluster.docker_image.url string ALL -resources.jobs.*.tasks[*].new_cluster.driver_instance_pool_id string ALL -resources.jobs.*.tasks[*].new_cluster.driver_node_type_flexibility *compute.NodeTypeFlexibility ALL -resources.jobs.*.tasks[*].new_cluster.driver_node_type_flexibility.alternate_node_type_ids []string ALL -resources.jobs.*.tasks[*].new_cluster.driver_node_type_flexibility.alternate_node_type_ids[*] string ALL -resources.jobs.*.tasks[*].new_cluster.driver_node_type_id string ALL -resources.jobs.*.tasks[*].new_cluster.enable_elastic_disk bool ALL -resources.jobs.*.tasks[*].new_cluster.enable_local_disk_encryption bool ALL -resources.jobs.*.tasks[*].new_cluster.gcp_attributes *compute.GcpAttributes ALL -resources.jobs.*.tasks[*].new_cluster.gcp_attributes.availability compute.GcpAvailability ALL -resources.jobs.*.tasks[*].new_cluster.gcp_attributes.boot_disk_size int ALL -resources.jobs.*.tasks[*].new_cluster.gcp_attributes.confidential_compute_type compute.ConfidentialComputeType ALL -resources.jobs.*.tasks[*].new_cluster.gcp_attributes.first_on_demand int ALL -resources.jobs.*.tasks[*].new_cluster.gcp_attributes.google_service_account string ALL -resources.jobs.*.tasks[*].new_cluster.gcp_attributes.local_ssd_count int ALL -resources.jobs.*.tasks[*].new_cluster.gcp_attributes.use_preemptible_executors bool ALL -resources.jobs.*.tasks[*].new_cluster.gcp_attributes.zone_id string ALL -resources.jobs.*.tasks[*].new_cluster.init_scripts []compute.InitScriptInfo ALL -resources.jobs.*.tasks[*].new_cluster.init_scripts[*] compute.InitScriptInfo ALL -resources.jobs.*.tasks[*].new_cluster.init_scripts[*].abfss *compute.Adlsgen2Info ALL -resources.jobs.*.tasks[*].new_cluster.init_scripts[*].abfss.destination string ALL -resources.jobs.*.tasks[*].new_cluster.init_scripts[*].dbfs *compute.DbfsStorageInfo ALL -resources.jobs.*.tasks[*].new_cluster.init_scripts[*].dbfs.destination string ALL -resources.jobs.*.tasks[*].new_cluster.init_scripts[*].file *compute.LocalFileInfo ALL -resources.jobs.*.tasks[*].new_cluster.init_scripts[*].file.destination string ALL -resources.jobs.*.tasks[*].new_cluster.init_scripts[*].gcs *compute.GcsStorageInfo ALL -resources.jobs.*.tasks[*].new_cluster.init_scripts[*].gcs.destination string ALL -resources.jobs.*.tasks[*].new_cluster.init_scripts[*].s3 *compute.S3StorageInfo ALL -resources.jobs.*.tasks[*].new_cluster.init_scripts[*].s3.canned_acl string ALL -resources.jobs.*.tasks[*].new_cluster.init_scripts[*].s3.destination string ALL -resources.jobs.*.tasks[*].new_cluster.init_scripts[*].s3.enable_encryption bool ALL -resources.jobs.*.tasks[*].new_cluster.init_scripts[*].s3.encryption_type string ALL -resources.jobs.*.tasks[*].new_cluster.init_scripts[*].s3.endpoint string ALL -resources.jobs.*.tasks[*].new_cluster.init_scripts[*].s3.kms_key string ALL -resources.jobs.*.tasks[*].new_cluster.init_scripts[*].s3.region string ALL -resources.jobs.*.tasks[*].new_cluster.init_scripts[*].volumes *compute.VolumesStorageInfo ALL -resources.jobs.*.tasks[*].new_cluster.init_scripts[*].volumes.destination string ALL -resources.jobs.*.tasks[*].new_cluster.init_scripts[*].workspace *compute.WorkspaceStorageInfo ALL -resources.jobs.*.tasks[*].new_cluster.init_scripts[*].workspace.destination string ALL -resources.jobs.*.tasks[*].new_cluster.instance_pool_id string ALL -resources.jobs.*.tasks[*].new_cluster.is_single_node bool ALL -resources.jobs.*.tasks[*].new_cluster.kind compute.Kind ALL -resources.jobs.*.tasks[*].new_cluster.node_type_id string ALL -resources.jobs.*.tasks[*].new_cluster.num_workers int ALL -resources.jobs.*.tasks[*].new_cluster.policy_id string ALL -resources.jobs.*.tasks[*].new_cluster.remote_disk_throughput int ALL -resources.jobs.*.tasks[*].new_cluster.runtime_engine compute.RuntimeEngine ALL -resources.jobs.*.tasks[*].new_cluster.single_user_name string ALL -resources.jobs.*.tasks[*].new_cluster.spark_conf map[string]string ALL -resources.jobs.*.tasks[*].new_cluster.spark_conf.* string ALL -resources.jobs.*.tasks[*].new_cluster.spark_env_vars map[string]string ALL -resources.jobs.*.tasks[*].new_cluster.spark_env_vars.* string ALL -resources.jobs.*.tasks[*].new_cluster.spark_version string ALL -resources.jobs.*.tasks[*].new_cluster.ssh_public_keys []string ALL -resources.jobs.*.tasks[*].new_cluster.ssh_public_keys[*] string ALL -resources.jobs.*.tasks[*].new_cluster.total_initial_remote_disk_size int ALL -resources.jobs.*.tasks[*].new_cluster.use_ml_runtime bool ALL -resources.jobs.*.tasks[*].new_cluster.worker_node_type_flexibility *compute.NodeTypeFlexibility ALL -resources.jobs.*.tasks[*].new_cluster.worker_node_type_flexibility.alternate_node_type_ids []string ALL -resources.jobs.*.tasks[*].new_cluster.worker_node_type_flexibility.alternate_node_type_ids[*] string ALL -resources.jobs.*.tasks[*].new_cluster.workload_type *compute.WorkloadType ALL -resources.jobs.*.tasks[*].new_cluster.workload_type.clients compute.ClientsTypes ALL -resources.jobs.*.tasks[*].new_cluster.workload_type.clients.jobs bool ALL -resources.jobs.*.tasks[*].new_cluster.workload_type.clients.notebooks bool ALL -resources.jobs.*.tasks[*].notebook_task *jobs.NotebookTask ALL -resources.jobs.*.tasks[*].notebook_task.base_parameters map[string]string ALL -resources.jobs.*.tasks[*].notebook_task.base_parameters.* string ALL -resources.jobs.*.tasks[*].notebook_task.notebook_path string ALL -resources.jobs.*.tasks[*].notebook_task.source jobs.Source ALL -resources.jobs.*.tasks[*].notebook_task.warehouse_id string ALL -resources.jobs.*.tasks[*].notification_settings *jobs.TaskNotificationSettings ALL -resources.jobs.*.tasks[*].notification_settings.alert_on_last_attempt bool ALL -resources.jobs.*.tasks[*].notification_settings.no_alert_for_canceled_runs bool ALL -resources.jobs.*.tasks[*].notification_settings.no_alert_for_skipped_runs bool ALL -resources.jobs.*.tasks[*].pipeline_task *jobs.PipelineTask ALL -resources.jobs.*.tasks[*].pipeline_task.full_refresh bool ALL -resources.jobs.*.tasks[*].pipeline_task.pipeline_id string ALL -resources.jobs.*.tasks[*].power_bi_task *jobs.PowerBiTask ALL -resources.jobs.*.tasks[*].power_bi_task.connection_resource_name string ALL -resources.jobs.*.tasks[*].power_bi_task.power_bi_model *jobs.PowerBiModel ALL -resources.jobs.*.tasks[*].power_bi_task.power_bi_model.authentication_method jobs.AuthenticationMethod ALL -resources.jobs.*.tasks[*].power_bi_task.power_bi_model.model_name string ALL -resources.jobs.*.tasks[*].power_bi_task.power_bi_model.overwrite_existing bool ALL -resources.jobs.*.tasks[*].power_bi_task.power_bi_model.storage_mode jobs.StorageMode ALL -resources.jobs.*.tasks[*].power_bi_task.power_bi_model.workspace_name string ALL -resources.jobs.*.tasks[*].power_bi_task.refresh_after_update bool ALL -resources.jobs.*.tasks[*].power_bi_task.tables []jobs.PowerBiTable ALL -resources.jobs.*.tasks[*].power_bi_task.tables[*] jobs.PowerBiTable ALL -resources.jobs.*.tasks[*].power_bi_task.tables[*].catalog string ALL -resources.jobs.*.tasks[*].power_bi_task.tables[*].name string ALL -resources.jobs.*.tasks[*].power_bi_task.tables[*].schema string ALL -resources.jobs.*.tasks[*].power_bi_task.tables[*].storage_mode jobs.StorageMode ALL -resources.jobs.*.tasks[*].power_bi_task.warehouse_id string ALL -resources.jobs.*.tasks[*].python_wheel_task *jobs.PythonWheelTask ALL -resources.jobs.*.tasks[*].python_wheel_task.entry_point string ALL -resources.jobs.*.tasks[*].python_wheel_task.named_parameters map[string]string ALL -resources.jobs.*.tasks[*].python_wheel_task.named_parameters.* string ALL -resources.jobs.*.tasks[*].python_wheel_task.package_name string ALL -resources.jobs.*.tasks[*].python_wheel_task.parameters []string ALL -resources.jobs.*.tasks[*].python_wheel_task.parameters[*] string ALL -resources.jobs.*.tasks[*].retry_on_timeout bool ALL -resources.jobs.*.tasks[*].run_if jobs.RunIf ALL -resources.jobs.*.tasks[*].run_job_task *jobs.RunJobTask ALL -resources.jobs.*.tasks[*].run_job_task.dbt_commands []string ALL -resources.jobs.*.tasks[*].run_job_task.dbt_commands[*] string ALL -resources.jobs.*.tasks[*].run_job_task.jar_params []string ALL -resources.jobs.*.tasks[*].run_job_task.jar_params[*] string ALL -resources.jobs.*.tasks[*].run_job_task.job_id int64 ALL -resources.jobs.*.tasks[*].run_job_task.job_parameters map[string]string ALL -resources.jobs.*.tasks[*].run_job_task.job_parameters.* string ALL -resources.jobs.*.tasks[*].run_job_task.notebook_params map[string]string ALL -resources.jobs.*.tasks[*].run_job_task.notebook_params.* string ALL -resources.jobs.*.tasks[*].run_job_task.pipeline_params *jobs.PipelineParams ALL -resources.jobs.*.tasks[*].run_job_task.pipeline_params.full_refresh bool ALL -resources.jobs.*.tasks[*].run_job_task.python_named_params map[string]string ALL -resources.jobs.*.tasks[*].run_job_task.python_named_params.* string ALL -resources.jobs.*.tasks[*].run_job_task.python_params []string ALL -resources.jobs.*.tasks[*].run_job_task.python_params[*] string ALL -resources.jobs.*.tasks[*].run_job_task.spark_submit_params []string ALL -resources.jobs.*.tasks[*].run_job_task.spark_submit_params[*] string ALL -resources.jobs.*.tasks[*].run_job_task.sql_params map[string]string ALL -resources.jobs.*.tasks[*].run_job_task.sql_params.* string ALL -resources.jobs.*.tasks[*].spark_jar_task *jobs.SparkJarTask ALL -resources.jobs.*.tasks[*].spark_jar_task.jar_uri string ALL -resources.jobs.*.tasks[*].spark_jar_task.main_class_name string ALL -resources.jobs.*.tasks[*].spark_jar_task.parameters []string ALL -resources.jobs.*.tasks[*].spark_jar_task.parameters[*] string ALL -resources.jobs.*.tasks[*].spark_jar_task.run_as_repl bool ALL -resources.jobs.*.tasks[*].spark_python_task *jobs.SparkPythonTask ALL -resources.jobs.*.tasks[*].spark_python_task.parameters []string ALL -resources.jobs.*.tasks[*].spark_python_task.parameters[*] string ALL -resources.jobs.*.tasks[*].spark_python_task.python_file string ALL -resources.jobs.*.tasks[*].spark_python_task.source jobs.Source ALL -resources.jobs.*.tasks[*].spark_submit_task *jobs.SparkSubmitTask ALL -resources.jobs.*.tasks[*].spark_submit_task.parameters []string ALL -resources.jobs.*.tasks[*].spark_submit_task.parameters[*] string ALL -resources.jobs.*.tasks[*].sql_task *jobs.SqlTask ALL -resources.jobs.*.tasks[*].sql_task.alert *jobs.SqlTaskAlert ALL -resources.jobs.*.tasks[*].sql_task.alert.alert_id string ALL -resources.jobs.*.tasks[*].sql_task.alert.pause_subscriptions bool ALL -resources.jobs.*.tasks[*].sql_task.alert.subscriptions []jobs.SqlTaskSubscription ALL -resources.jobs.*.tasks[*].sql_task.alert.subscriptions[*] jobs.SqlTaskSubscription ALL -resources.jobs.*.tasks[*].sql_task.alert.subscriptions[*].destination_id string ALL -resources.jobs.*.tasks[*].sql_task.alert.subscriptions[*].user_name string ALL -resources.jobs.*.tasks[*].sql_task.dashboard *jobs.SqlTaskDashboard ALL -resources.jobs.*.tasks[*].sql_task.dashboard.custom_subject string ALL -resources.jobs.*.tasks[*].sql_task.dashboard.dashboard_id string ALL -resources.jobs.*.tasks[*].sql_task.dashboard.pause_subscriptions bool ALL -resources.jobs.*.tasks[*].sql_task.dashboard.subscriptions []jobs.SqlTaskSubscription ALL -resources.jobs.*.tasks[*].sql_task.dashboard.subscriptions[*] jobs.SqlTaskSubscription ALL -resources.jobs.*.tasks[*].sql_task.dashboard.subscriptions[*].destination_id string ALL -resources.jobs.*.tasks[*].sql_task.dashboard.subscriptions[*].user_name string ALL -resources.jobs.*.tasks[*].sql_task.file *jobs.SqlTaskFile ALL -resources.jobs.*.tasks[*].sql_task.file.path string ALL -resources.jobs.*.tasks[*].sql_task.file.source jobs.Source ALL -resources.jobs.*.tasks[*].sql_task.parameters map[string]string ALL -resources.jobs.*.tasks[*].sql_task.parameters.* string ALL -resources.jobs.*.tasks[*].sql_task.query *jobs.SqlTaskQuery ALL -resources.jobs.*.tasks[*].sql_task.query.query_id string ALL -resources.jobs.*.tasks[*].sql_task.warehouse_id string ALL -resources.jobs.*.tasks[*].task_key string ALL -resources.jobs.*.tasks[*].timeout_seconds int ALL -resources.jobs.*.tasks[*].webhook_notifications *jobs.WebhookNotifications ALL -resources.jobs.*.tasks[*].webhook_notifications.on_duration_warning_threshold_exceeded []jobs.Webhook ALL -resources.jobs.*.tasks[*].webhook_notifications.on_duration_warning_threshold_exceeded[*] jobs.Webhook ALL -resources.jobs.*.tasks[*].webhook_notifications.on_duration_warning_threshold_exceeded[*].id string ALL -resources.jobs.*.tasks[*].webhook_notifications.on_failure []jobs.Webhook ALL -resources.jobs.*.tasks[*].webhook_notifications.on_failure[*] jobs.Webhook ALL -resources.jobs.*.tasks[*].webhook_notifications.on_failure[*].id string ALL -resources.jobs.*.tasks[*].webhook_notifications.on_start []jobs.Webhook ALL -resources.jobs.*.tasks[*].webhook_notifications.on_start[*] jobs.Webhook ALL -resources.jobs.*.tasks[*].webhook_notifications.on_start[*].id string ALL -resources.jobs.*.tasks[*].webhook_notifications.on_streaming_backlog_exceeded []jobs.Webhook ALL -resources.jobs.*.tasks[*].webhook_notifications.on_streaming_backlog_exceeded[*] jobs.Webhook ALL -resources.jobs.*.tasks[*].webhook_notifications.on_streaming_backlog_exceeded[*].id string ALL -resources.jobs.*.tasks[*].webhook_notifications.on_success []jobs.Webhook ALL -resources.jobs.*.tasks[*].webhook_notifications.on_success[*] jobs.Webhook ALL -resources.jobs.*.tasks[*].webhook_notifications.on_success[*].id string ALL -resources.jobs.*.timeout_seconds int ALL -resources.jobs.*.trigger *jobs.TriggerSettings ALL -resources.jobs.*.trigger.file_arrival *jobs.FileArrivalTriggerConfiguration ALL -resources.jobs.*.trigger.file_arrival.min_time_between_triggers_seconds int ALL -resources.jobs.*.trigger.file_arrival.url string ALL -resources.jobs.*.trigger.file_arrival.wait_after_last_change_seconds int ALL -resources.jobs.*.trigger.model *jobs.ModelTriggerConfiguration ALL -resources.jobs.*.trigger.model.aliases []string ALL -resources.jobs.*.trigger.model.aliases[*] string ALL -resources.jobs.*.trigger.model.condition jobs.ModelTriggerConfigurationCondition ALL -resources.jobs.*.trigger.model.min_time_between_triggers_seconds int ALL -resources.jobs.*.trigger.model.securable_name string ALL -resources.jobs.*.trigger.model.wait_after_last_change_seconds int ALL -resources.jobs.*.trigger.pause_status jobs.PauseStatus ALL -resources.jobs.*.trigger.periodic *jobs.PeriodicTriggerConfiguration ALL -resources.jobs.*.trigger.periodic.interval int ALL -resources.jobs.*.trigger.periodic.unit jobs.PeriodicTriggerConfigurationTimeUnit ALL -resources.jobs.*.trigger.table_update *jobs.TableUpdateTriggerConfiguration ALL -resources.jobs.*.trigger.table_update.condition jobs.Condition ALL -resources.jobs.*.trigger.table_update.min_time_between_triggers_seconds int ALL -resources.jobs.*.trigger.table_update.table_names []string ALL -resources.jobs.*.trigger.table_update.table_names[*] string ALL -resources.jobs.*.trigger.table_update.wait_after_last_change_seconds int ALL -resources.jobs.*.trigger_state *jobs.TriggerStateProto REMOTE -resources.jobs.*.trigger_state.file_arrival *jobs.FileArrivalTriggerState REMOTE -resources.jobs.*.trigger_state.file_arrival.using_file_events bool REMOTE -resources.jobs.*.trigger_state.table *jobs.TableTriggerState REMOTE -resources.jobs.*.trigger_state.table.last_seen_table_states []jobs.TableState REMOTE -resources.jobs.*.trigger_state.table.last_seen_table_states[*] jobs.TableState REMOTE -resources.jobs.*.trigger_state.table.last_seen_table_states[*].has_seen_updates bool REMOTE -resources.jobs.*.trigger_state.table.last_seen_table_states[*].table_name string REMOTE -resources.jobs.*.trigger_state.table.using_scalable_monitoring bool REMOTE -resources.jobs.*.url string INPUT -resources.jobs.*.usage_policy_id string ALL -resources.jobs.*.webhook_notifications *jobs.WebhookNotifications ALL -resources.jobs.*.webhook_notifications.on_duration_warning_threshold_exceeded []jobs.Webhook ALL -resources.jobs.*.webhook_notifications.on_duration_warning_threshold_exceeded[*] jobs.Webhook ALL -resources.jobs.*.webhook_notifications.on_duration_warning_threshold_exceeded[*].id string ALL -resources.jobs.*.webhook_notifications.on_failure []jobs.Webhook ALL -resources.jobs.*.webhook_notifications.on_failure[*] jobs.Webhook ALL -resources.jobs.*.webhook_notifications.on_failure[*].id string ALL -resources.jobs.*.webhook_notifications.on_start []jobs.Webhook ALL -resources.jobs.*.webhook_notifications.on_start[*] jobs.Webhook ALL -resources.jobs.*.webhook_notifications.on_start[*].id string ALL -resources.jobs.*.webhook_notifications.on_streaming_backlog_exceeded []jobs.Webhook ALL -resources.jobs.*.webhook_notifications.on_streaming_backlog_exceeded[*] jobs.Webhook ALL -resources.jobs.*.webhook_notifications.on_streaming_backlog_exceeded[*].id string ALL -resources.jobs.*.webhook_notifications.on_success []jobs.Webhook ALL -resources.jobs.*.webhook_notifications.on_success[*] jobs.Webhook ALL -resources.jobs.*.webhook_notifications.on_success[*].id string ALL -resources.jobs.*.permissions.object_id string ALL -resources.jobs.*.permissions[*] dresources.StatePermission ALL -resources.jobs.*.permissions[*].group_name string ALL -resources.jobs.*.permissions[*].level iam.PermissionLevel ALL -resources.jobs.*.permissions[*].service_principal_name string ALL -resources.jobs.*.permissions[*].user_name string ALL -resources.model_serving_endpoints.*.ai_gateway *serving.AiGatewayConfig INPUT STATE -resources.model_serving_endpoints.*.ai_gateway.fallback_config *serving.FallbackConfig INPUT STATE -resources.model_serving_endpoints.*.ai_gateway.fallback_config.enabled bool INPUT STATE -resources.model_serving_endpoints.*.ai_gateway.guardrails *serving.AiGatewayGuardrails INPUT STATE -resources.model_serving_endpoints.*.ai_gateway.guardrails.input *serving.AiGatewayGuardrailParameters INPUT STATE -resources.model_serving_endpoints.*.ai_gateway.guardrails.input.invalid_keywords []string INPUT STATE -resources.model_serving_endpoints.*.ai_gateway.guardrails.input.invalid_keywords[*] string INPUT STATE -resources.model_serving_endpoints.*.ai_gateway.guardrails.input.pii *serving.AiGatewayGuardrailPiiBehavior INPUT STATE -resources.model_serving_endpoints.*.ai_gateway.guardrails.input.pii.behavior serving.AiGatewayGuardrailPiiBehaviorBehavior INPUT STATE -resources.model_serving_endpoints.*.ai_gateway.guardrails.input.safety bool INPUT STATE -resources.model_serving_endpoints.*.ai_gateway.guardrails.input.valid_topics []string INPUT STATE -resources.model_serving_endpoints.*.ai_gateway.guardrails.input.valid_topics[*] string INPUT STATE -resources.model_serving_endpoints.*.ai_gateway.guardrails.output *serving.AiGatewayGuardrailParameters INPUT STATE -resources.model_serving_endpoints.*.ai_gateway.guardrails.output.invalid_keywords []string INPUT STATE -resources.model_serving_endpoints.*.ai_gateway.guardrails.output.invalid_keywords[*] string INPUT STATE -resources.model_serving_endpoints.*.ai_gateway.guardrails.output.pii *serving.AiGatewayGuardrailPiiBehavior INPUT STATE -resources.model_serving_endpoints.*.ai_gateway.guardrails.output.pii.behavior serving.AiGatewayGuardrailPiiBehaviorBehavior INPUT STATE -resources.model_serving_endpoints.*.ai_gateway.guardrails.output.safety bool INPUT STATE -resources.model_serving_endpoints.*.ai_gateway.guardrails.output.valid_topics []string INPUT STATE -resources.model_serving_endpoints.*.ai_gateway.guardrails.output.valid_topics[*] string INPUT STATE -resources.model_serving_endpoints.*.ai_gateway.inference_table_config *serving.AiGatewayInferenceTableConfig INPUT STATE -resources.model_serving_endpoints.*.ai_gateway.inference_table_config.catalog_name string INPUT STATE -resources.model_serving_endpoints.*.ai_gateway.inference_table_config.enabled bool INPUT STATE -resources.model_serving_endpoints.*.ai_gateway.inference_table_config.schema_name string INPUT STATE -resources.model_serving_endpoints.*.ai_gateway.inference_table_config.table_name_prefix string INPUT STATE -resources.model_serving_endpoints.*.ai_gateway.rate_limits []serving.AiGatewayRateLimit INPUT STATE -resources.model_serving_endpoints.*.ai_gateway.rate_limits[*] serving.AiGatewayRateLimit INPUT STATE -resources.model_serving_endpoints.*.ai_gateway.rate_limits[*].calls int64 INPUT STATE -resources.model_serving_endpoints.*.ai_gateway.rate_limits[*].key serving.AiGatewayRateLimitKey INPUT STATE -resources.model_serving_endpoints.*.ai_gateway.rate_limits[*].principal string INPUT STATE -resources.model_serving_endpoints.*.ai_gateway.rate_limits[*].renewal_period serving.AiGatewayRateLimitRenewalPeriod INPUT STATE -resources.model_serving_endpoints.*.ai_gateway.rate_limits[*].tokens int64 INPUT STATE -resources.model_serving_endpoints.*.ai_gateway.usage_tracking_config *serving.AiGatewayUsageTrackingConfig INPUT STATE -resources.model_serving_endpoints.*.ai_gateway.usage_tracking_config.enabled bool INPUT STATE -resources.model_serving_endpoints.*.budget_policy_id string INPUT STATE -resources.model_serving_endpoints.*.config *serving.EndpointCoreConfigInput INPUT STATE -resources.model_serving_endpoints.*.config.auto_capture_config *serving.AutoCaptureConfigInput INPUT STATE -resources.model_serving_endpoints.*.config.auto_capture_config.catalog_name string INPUT STATE -resources.model_serving_endpoints.*.config.auto_capture_config.enabled bool INPUT STATE -resources.model_serving_endpoints.*.config.auto_capture_config.schema_name string INPUT STATE -resources.model_serving_endpoints.*.config.auto_capture_config.table_name_prefix string INPUT STATE -resources.model_serving_endpoints.*.config.served_entities []serving.ServedEntityInput INPUT STATE -resources.model_serving_endpoints.*.config.served_entities[*] serving.ServedEntityInput INPUT STATE -resources.model_serving_endpoints.*.config.served_entities[*].burst_scaling_enabled bool INPUT STATE -resources.model_serving_endpoints.*.config.served_entities[*].entity_name string INPUT STATE -resources.model_serving_endpoints.*.config.served_entities[*].entity_version string INPUT STATE -resources.model_serving_endpoints.*.config.served_entities[*].environment_vars map[string]string INPUT STATE -resources.model_serving_endpoints.*.config.served_entities[*].environment_vars.* string INPUT STATE -resources.model_serving_endpoints.*.config.served_entities[*].external_model *serving.ExternalModel INPUT STATE -resources.model_serving_endpoints.*.config.served_entities[*].external_model.ai21labs_config *serving.Ai21LabsConfig INPUT STATE -resources.model_serving_endpoints.*.config.served_entities[*].external_model.ai21labs_config.ai21labs_api_key string INPUT STATE -resources.model_serving_endpoints.*.config.served_entities[*].external_model.ai21labs_config.ai21labs_api_key_plaintext string INPUT STATE -resources.model_serving_endpoints.*.config.served_entities[*].external_model.amazon_bedrock_config *serving.AmazonBedrockConfig INPUT STATE -resources.model_serving_endpoints.*.config.served_entities[*].external_model.amazon_bedrock_config.aws_access_key_id string INPUT STATE -resources.model_serving_endpoints.*.config.served_entities[*].external_model.amazon_bedrock_config.aws_access_key_id_plaintext string INPUT STATE -resources.model_serving_endpoints.*.config.served_entities[*].external_model.amazon_bedrock_config.aws_region string INPUT STATE -resources.model_serving_endpoints.*.config.served_entities[*].external_model.amazon_bedrock_config.aws_secret_access_key string INPUT STATE -resources.model_serving_endpoints.*.config.served_entities[*].external_model.amazon_bedrock_config.aws_secret_access_key_plaintext string INPUT STATE -resources.model_serving_endpoints.*.config.served_entities[*].external_model.amazon_bedrock_config.bedrock_provider serving.AmazonBedrockConfigBedrockProvider INPUT STATE -resources.model_serving_endpoints.*.config.served_entities[*].external_model.amazon_bedrock_config.instance_profile_arn string INPUT STATE -resources.model_serving_endpoints.*.config.served_entities[*].external_model.anthropic_config *serving.AnthropicConfig INPUT STATE -resources.model_serving_endpoints.*.config.served_entities[*].external_model.anthropic_config.anthropic_api_key string INPUT STATE -resources.model_serving_endpoints.*.config.served_entities[*].external_model.anthropic_config.anthropic_api_key_plaintext string INPUT STATE -resources.model_serving_endpoints.*.config.served_entities[*].external_model.cohere_config *serving.CohereConfig INPUT STATE -resources.model_serving_endpoints.*.config.served_entities[*].external_model.cohere_config.cohere_api_base string INPUT STATE -resources.model_serving_endpoints.*.config.served_entities[*].external_model.cohere_config.cohere_api_key string INPUT STATE -resources.model_serving_endpoints.*.config.served_entities[*].external_model.cohere_config.cohere_api_key_plaintext string INPUT STATE -resources.model_serving_endpoints.*.config.served_entities[*].external_model.custom_provider_config *serving.CustomProviderConfig INPUT STATE -resources.model_serving_endpoints.*.config.served_entities[*].external_model.custom_provider_config.api_key_auth *serving.ApiKeyAuth INPUT STATE -resources.model_serving_endpoints.*.config.served_entities[*].external_model.custom_provider_config.api_key_auth.key string INPUT STATE -resources.model_serving_endpoints.*.config.served_entities[*].external_model.custom_provider_config.api_key_auth.value string INPUT STATE -resources.model_serving_endpoints.*.config.served_entities[*].external_model.custom_provider_config.api_key_auth.value_plaintext string INPUT STATE -resources.model_serving_endpoints.*.config.served_entities[*].external_model.custom_provider_config.bearer_token_auth *serving.BearerTokenAuth INPUT STATE -resources.model_serving_endpoints.*.config.served_entities[*].external_model.custom_provider_config.bearer_token_auth.token string INPUT STATE -resources.model_serving_endpoints.*.config.served_entities[*].external_model.custom_provider_config.bearer_token_auth.token_plaintext string INPUT STATE -resources.model_serving_endpoints.*.config.served_entities[*].external_model.custom_provider_config.custom_provider_url string INPUT STATE -resources.model_serving_endpoints.*.config.served_entities[*].external_model.databricks_model_serving_config *serving.DatabricksModelServingConfig INPUT STATE -resources.model_serving_endpoints.*.config.served_entities[*].external_model.databricks_model_serving_config.databricks_api_token string INPUT STATE -resources.model_serving_endpoints.*.config.served_entities[*].external_model.databricks_model_serving_config.databricks_api_token_plaintext string INPUT STATE -resources.model_serving_endpoints.*.config.served_entities[*].external_model.databricks_model_serving_config.databricks_workspace_url string INPUT STATE -resources.model_serving_endpoints.*.config.served_entities[*].external_model.google_cloud_vertex_ai_config *serving.GoogleCloudVertexAiConfig INPUT STATE -resources.model_serving_endpoints.*.config.served_entities[*].external_model.google_cloud_vertex_ai_config.private_key string INPUT STATE -resources.model_serving_endpoints.*.config.served_entities[*].external_model.google_cloud_vertex_ai_config.private_key_plaintext string INPUT STATE -resources.model_serving_endpoints.*.config.served_entities[*].external_model.google_cloud_vertex_ai_config.project_id string INPUT STATE -resources.model_serving_endpoints.*.config.served_entities[*].external_model.google_cloud_vertex_ai_config.region string INPUT STATE -resources.model_serving_endpoints.*.config.served_entities[*].external_model.name string INPUT STATE -resources.model_serving_endpoints.*.config.served_entities[*].external_model.openai_config *serving.OpenAiConfig INPUT STATE -resources.model_serving_endpoints.*.config.served_entities[*].external_model.openai_config.microsoft_entra_client_id string INPUT STATE -resources.model_serving_endpoints.*.config.served_entities[*].external_model.openai_config.microsoft_entra_client_secret string INPUT STATE -resources.model_serving_endpoints.*.config.served_entities[*].external_model.openai_config.microsoft_entra_client_secret_plaintext string INPUT STATE -resources.model_serving_endpoints.*.config.served_entities[*].external_model.openai_config.microsoft_entra_tenant_id string INPUT STATE -resources.model_serving_endpoints.*.config.served_entities[*].external_model.openai_config.openai_api_base string INPUT STATE -resources.model_serving_endpoints.*.config.served_entities[*].external_model.openai_config.openai_api_key string INPUT STATE -resources.model_serving_endpoints.*.config.served_entities[*].external_model.openai_config.openai_api_key_plaintext string INPUT STATE -resources.model_serving_endpoints.*.config.served_entities[*].external_model.openai_config.openai_api_type string INPUT STATE -resources.model_serving_endpoints.*.config.served_entities[*].external_model.openai_config.openai_api_version string INPUT STATE -resources.model_serving_endpoints.*.config.served_entities[*].external_model.openai_config.openai_deployment_name string INPUT STATE -resources.model_serving_endpoints.*.config.served_entities[*].external_model.openai_config.openai_organization string INPUT STATE -resources.model_serving_endpoints.*.config.served_entities[*].external_model.palm_config *serving.PaLmConfig INPUT STATE -resources.model_serving_endpoints.*.config.served_entities[*].external_model.palm_config.palm_api_key string INPUT STATE -resources.model_serving_endpoints.*.config.served_entities[*].external_model.palm_config.palm_api_key_plaintext string INPUT STATE -resources.model_serving_endpoints.*.config.served_entities[*].external_model.provider serving.ExternalModelProvider INPUT STATE -resources.model_serving_endpoints.*.config.served_entities[*].external_model.task string INPUT STATE -resources.model_serving_endpoints.*.config.served_entities[*].instance_profile_arn string INPUT STATE -resources.model_serving_endpoints.*.config.served_entities[*].max_provisioned_concurrency int INPUT STATE -resources.model_serving_endpoints.*.config.served_entities[*].max_provisioned_throughput int INPUT STATE -resources.model_serving_endpoints.*.config.served_entities[*].min_provisioned_concurrency int INPUT STATE -resources.model_serving_endpoints.*.config.served_entities[*].min_provisioned_throughput int INPUT STATE -resources.model_serving_endpoints.*.config.served_entities[*].name string INPUT STATE -resources.model_serving_endpoints.*.config.served_entities[*].provisioned_model_units int64 INPUT STATE -resources.model_serving_endpoints.*.config.served_entities[*].scale_to_zero_enabled bool INPUT STATE -resources.model_serving_endpoints.*.config.served_entities[*].workload_size string INPUT STATE -resources.model_serving_endpoints.*.config.served_entities[*].workload_type serving.ServingModelWorkloadType INPUT STATE -resources.model_serving_endpoints.*.config.served_models []serving.ServedModelInput INPUT STATE -resources.model_serving_endpoints.*.config.served_models[*] serving.ServedModelInput INPUT STATE -resources.model_serving_endpoints.*.config.served_models[*].burst_scaling_enabled bool INPUT STATE -resources.model_serving_endpoints.*.config.served_models[*].environment_vars map[string]string INPUT STATE -resources.model_serving_endpoints.*.config.served_models[*].environment_vars.* string INPUT STATE -resources.model_serving_endpoints.*.config.served_models[*].instance_profile_arn string INPUT STATE -resources.model_serving_endpoints.*.config.served_models[*].max_provisioned_concurrency int INPUT STATE -resources.model_serving_endpoints.*.config.served_models[*].max_provisioned_throughput int INPUT STATE -resources.model_serving_endpoints.*.config.served_models[*].min_provisioned_concurrency int INPUT STATE -resources.model_serving_endpoints.*.config.served_models[*].min_provisioned_throughput int INPUT STATE -resources.model_serving_endpoints.*.config.served_models[*].model_name string INPUT STATE -resources.model_serving_endpoints.*.config.served_models[*].model_version string INPUT STATE -resources.model_serving_endpoints.*.config.served_models[*].name string INPUT STATE -resources.model_serving_endpoints.*.config.served_models[*].provisioned_model_units int64 INPUT STATE -resources.model_serving_endpoints.*.config.served_models[*].scale_to_zero_enabled bool INPUT STATE -resources.model_serving_endpoints.*.config.served_models[*].workload_size string INPUT STATE -resources.model_serving_endpoints.*.config.served_models[*].workload_type serving.ServedModelInputWorkloadType INPUT STATE -resources.model_serving_endpoints.*.config.traffic_config *serving.TrafficConfig INPUT STATE -resources.model_serving_endpoints.*.config.traffic_config.routes []serving.Route INPUT STATE -resources.model_serving_endpoints.*.config.traffic_config.routes[*] serving.Route INPUT STATE -resources.model_serving_endpoints.*.config.traffic_config.routes[*].served_entity_name string INPUT STATE -resources.model_serving_endpoints.*.config.traffic_config.routes[*].served_model_name string INPUT STATE -resources.model_serving_endpoints.*.config.traffic_config.routes[*].traffic_percentage int INPUT STATE -resources.model_serving_endpoints.*.description string INPUT STATE -resources.model_serving_endpoints.*.email_notifications *serving.EmailNotifications INPUT STATE -resources.model_serving_endpoints.*.email_notifications.on_update_failure []string INPUT STATE -resources.model_serving_endpoints.*.email_notifications.on_update_failure[*] string INPUT STATE -resources.model_serving_endpoints.*.email_notifications.on_update_success []string INPUT STATE -resources.model_serving_endpoints.*.email_notifications.on_update_success[*] string INPUT STATE -resources.model_serving_endpoints.*.endpoint_details *serving.ServingEndpointDetailed REMOTE -resources.model_serving_endpoints.*.endpoint_details.ai_gateway *serving.AiGatewayConfig REMOTE -resources.model_serving_endpoints.*.endpoint_details.ai_gateway.fallback_config *serving.FallbackConfig REMOTE -resources.model_serving_endpoints.*.endpoint_details.ai_gateway.fallback_config.enabled bool REMOTE -resources.model_serving_endpoints.*.endpoint_details.ai_gateway.guardrails *serving.AiGatewayGuardrails REMOTE -resources.model_serving_endpoints.*.endpoint_details.ai_gateway.guardrails.input *serving.AiGatewayGuardrailParameters REMOTE -resources.model_serving_endpoints.*.endpoint_details.ai_gateway.guardrails.input.invalid_keywords []string REMOTE -resources.model_serving_endpoints.*.endpoint_details.ai_gateway.guardrails.input.invalid_keywords[*] string REMOTE -resources.model_serving_endpoints.*.endpoint_details.ai_gateway.guardrails.input.pii *serving.AiGatewayGuardrailPiiBehavior REMOTE -resources.model_serving_endpoints.*.endpoint_details.ai_gateway.guardrails.input.pii.behavior serving.AiGatewayGuardrailPiiBehaviorBehavior REMOTE -resources.model_serving_endpoints.*.endpoint_details.ai_gateway.guardrails.input.safety bool REMOTE -resources.model_serving_endpoints.*.endpoint_details.ai_gateway.guardrails.input.valid_topics []string REMOTE -resources.model_serving_endpoints.*.endpoint_details.ai_gateway.guardrails.input.valid_topics[*] string REMOTE -resources.model_serving_endpoints.*.endpoint_details.ai_gateway.guardrails.output *serving.AiGatewayGuardrailParameters REMOTE -resources.model_serving_endpoints.*.endpoint_details.ai_gateway.guardrails.output.invalid_keywords []string REMOTE -resources.model_serving_endpoints.*.endpoint_details.ai_gateway.guardrails.output.invalid_keywords[*] string REMOTE -resources.model_serving_endpoints.*.endpoint_details.ai_gateway.guardrails.output.pii *serving.AiGatewayGuardrailPiiBehavior REMOTE -resources.model_serving_endpoints.*.endpoint_details.ai_gateway.guardrails.output.pii.behavior serving.AiGatewayGuardrailPiiBehaviorBehavior REMOTE -resources.model_serving_endpoints.*.endpoint_details.ai_gateway.guardrails.output.safety bool REMOTE -resources.model_serving_endpoints.*.endpoint_details.ai_gateway.guardrails.output.valid_topics []string REMOTE -resources.model_serving_endpoints.*.endpoint_details.ai_gateway.guardrails.output.valid_topics[*] string REMOTE -resources.model_serving_endpoints.*.endpoint_details.ai_gateway.inference_table_config *serving.AiGatewayInferenceTableConfig REMOTE -resources.model_serving_endpoints.*.endpoint_details.ai_gateway.inference_table_config.catalog_name string REMOTE -resources.model_serving_endpoints.*.endpoint_details.ai_gateway.inference_table_config.enabled bool REMOTE -resources.model_serving_endpoints.*.endpoint_details.ai_gateway.inference_table_config.schema_name string REMOTE -resources.model_serving_endpoints.*.endpoint_details.ai_gateway.inference_table_config.table_name_prefix string REMOTE -resources.model_serving_endpoints.*.endpoint_details.ai_gateway.rate_limits []serving.AiGatewayRateLimit REMOTE -resources.model_serving_endpoints.*.endpoint_details.ai_gateway.rate_limits[*] serving.AiGatewayRateLimit REMOTE -resources.model_serving_endpoints.*.endpoint_details.ai_gateway.rate_limits[*].calls int64 REMOTE -resources.model_serving_endpoints.*.endpoint_details.ai_gateway.rate_limits[*].key serving.AiGatewayRateLimitKey REMOTE -resources.model_serving_endpoints.*.endpoint_details.ai_gateway.rate_limits[*].principal string REMOTE -resources.model_serving_endpoints.*.endpoint_details.ai_gateway.rate_limits[*].renewal_period serving.AiGatewayRateLimitRenewalPeriod REMOTE -resources.model_serving_endpoints.*.endpoint_details.ai_gateway.rate_limits[*].tokens int64 REMOTE -resources.model_serving_endpoints.*.endpoint_details.ai_gateway.usage_tracking_config *serving.AiGatewayUsageTrackingConfig REMOTE -resources.model_serving_endpoints.*.endpoint_details.ai_gateway.usage_tracking_config.enabled bool REMOTE -resources.model_serving_endpoints.*.endpoint_details.budget_policy_id string REMOTE -resources.model_serving_endpoints.*.endpoint_details.config *serving.EndpointCoreConfigOutput REMOTE -resources.model_serving_endpoints.*.endpoint_details.config.auto_capture_config *serving.AutoCaptureConfigOutput REMOTE -resources.model_serving_endpoints.*.endpoint_details.config.auto_capture_config.catalog_name string REMOTE -resources.model_serving_endpoints.*.endpoint_details.config.auto_capture_config.enabled bool REMOTE -resources.model_serving_endpoints.*.endpoint_details.config.auto_capture_config.schema_name string REMOTE -resources.model_serving_endpoints.*.endpoint_details.config.auto_capture_config.state *serving.AutoCaptureState REMOTE -resources.model_serving_endpoints.*.endpoint_details.config.auto_capture_config.state.payload_table *serving.PayloadTable REMOTE -resources.model_serving_endpoints.*.endpoint_details.config.auto_capture_config.state.payload_table.name string REMOTE -resources.model_serving_endpoints.*.endpoint_details.config.auto_capture_config.state.payload_table.status string REMOTE -resources.model_serving_endpoints.*.endpoint_details.config.auto_capture_config.state.payload_table.status_message string REMOTE -resources.model_serving_endpoints.*.endpoint_details.config.auto_capture_config.table_name_prefix string REMOTE -resources.model_serving_endpoints.*.endpoint_details.config.config_version int64 REMOTE -resources.model_serving_endpoints.*.endpoint_details.config.served_entities []serving.ServedEntityOutput REMOTE -resources.model_serving_endpoints.*.endpoint_details.config.served_entities[*] serving.ServedEntityOutput REMOTE -resources.model_serving_endpoints.*.endpoint_details.config.served_entities[*].burst_scaling_enabled bool REMOTE -resources.model_serving_endpoints.*.endpoint_details.config.served_entities[*].creation_timestamp int64 REMOTE -resources.model_serving_endpoints.*.endpoint_details.config.served_entities[*].creator string REMOTE -resources.model_serving_endpoints.*.endpoint_details.config.served_entities[*].entity_name string REMOTE -resources.model_serving_endpoints.*.endpoint_details.config.served_entities[*].entity_version string REMOTE -resources.model_serving_endpoints.*.endpoint_details.config.served_entities[*].environment_vars map[string]string REMOTE -resources.model_serving_endpoints.*.endpoint_details.config.served_entities[*].environment_vars.* string REMOTE -resources.model_serving_endpoints.*.endpoint_details.config.served_entities[*].external_model *serving.ExternalModel REMOTE -resources.model_serving_endpoints.*.endpoint_details.config.served_entities[*].external_model.ai21labs_config *serving.Ai21LabsConfig REMOTE -resources.model_serving_endpoints.*.endpoint_details.config.served_entities[*].external_model.ai21labs_config.ai21labs_api_key string REMOTE -resources.model_serving_endpoints.*.endpoint_details.config.served_entities[*].external_model.ai21labs_config.ai21labs_api_key_plaintext string REMOTE -resources.model_serving_endpoints.*.endpoint_details.config.served_entities[*].external_model.amazon_bedrock_config *serving.AmazonBedrockConfig REMOTE -resources.model_serving_endpoints.*.endpoint_details.config.served_entities[*].external_model.amazon_bedrock_config.aws_access_key_id string REMOTE -resources.model_serving_endpoints.*.endpoint_details.config.served_entities[*].external_model.amazon_bedrock_config.aws_access_key_id_plaintext string REMOTE -resources.model_serving_endpoints.*.endpoint_details.config.served_entities[*].external_model.amazon_bedrock_config.aws_region string REMOTE -resources.model_serving_endpoints.*.endpoint_details.config.served_entities[*].external_model.amazon_bedrock_config.aws_secret_access_key string REMOTE -resources.model_serving_endpoints.*.endpoint_details.config.served_entities[*].external_model.amazon_bedrock_config.aws_secret_access_key_plaintext string REMOTE -resources.model_serving_endpoints.*.endpoint_details.config.served_entities[*].external_model.amazon_bedrock_config.bedrock_provider serving.AmazonBedrockConfigBedrockProvider REMOTE -resources.model_serving_endpoints.*.endpoint_details.config.served_entities[*].external_model.amazon_bedrock_config.instance_profile_arn string REMOTE -resources.model_serving_endpoints.*.endpoint_details.config.served_entities[*].external_model.anthropic_config *serving.AnthropicConfig REMOTE -resources.model_serving_endpoints.*.endpoint_details.config.served_entities[*].external_model.anthropic_config.anthropic_api_key string REMOTE -resources.model_serving_endpoints.*.endpoint_details.config.served_entities[*].external_model.anthropic_config.anthropic_api_key_plaintext string REMOTE -resources.model_serving_endpoints.*.endpoint_details.config.served_entities[*].external_model.cohere_config *serving.CohereConfig REMOTE -resources.model_serving_endpoints.*.endpoint_details.config.served_entities[*].external_model.cohere_config.cohere_api_base string REMOTE -resources.model_serving_endpoints.*.endpoint_details.config.served_entities[*].external_model.cohere_config.cohere_api_key string REMOTE -resources.model_serving_endpoints.*.endpoint_details.config.served_entities[*].external_model.cohere_config.cohere_api_key_plaintext string REMOTE -resources.model_serving_endpoints.*.endpoint_details.config.served_entities[*].external_model.custom_provider_config *serving.CustomProviderConfig REMOTE -resources.model_serving_endpoints.*.endpoint_details.config.served_entities[*].external_model.custom_provider_config.api_key_auth *serving.ApiKeyAuth REMOTE -resources.model_serving_endpoints.*.endpoint_details.config.served_entities[*].external_model.custom_provider_config.api_key_auth.key string REMOTE -resources.model_serving_endpoints.*.endpoint_details.config.served_entities[*].external_model.custom_provider_config.api_key_auth.value string REMOTE -resources.model_serving_endpoints.*.endpoint_details.config.served_entities[*].external_model.custom_provider_config.api_key_auth.value_plaintext string REMOTE -resources.model_serving_endpoints.*.endpoint_details.config.served_entities[*].external_model.custom_provider_config.bearer_token_auth *serving.BearerTokenAuth REMOTE -resources.model_serving_endpoints.*.endpoint_details.config.served_entities[*].external_model.custom_provider_config.bearer_token_auth.token string REMOTE -resources.model_serving_endpoints.*.endpoint_details.config.served_entities[*].external_model.custom_provider_config.bearer_token_auth.token_plaintext string REMOTE -resources.model_serving_endpoints.*.endpoint_details.config.served_entities[*].external_model.custom_provider_config.custom_provider_url string REMOTE -resources.model_serving_endpoints.*.endpoint_details.config.served_entities[*].external_model.databricks_model_serving_config *serving.DatabricksModelServingConfig REMOTE -resources.model_serving_endpoints.*.endpoint_details.config.served_entities[*].external_model.databricks_model_serving_config.databricks_api_token string REMOTE -resources.model_serving_endpoints.*.endpoint_details.config.served_entities[*].external_model.databricks_model_serving_config.databricks_api_token_plaintext string REMOTE -resources.model_serving_endpoints.*.endpoint_details.config.served_entities[*].external_model.databricks_model_serving_config.databricks_workspace_url string REMOTE -resources.model_serving_endpoints.*.endpoint_details.config.served_entities[*].external_model.google_cloud_vertex_ai_config *serving.GoogleCloudVertexAiConfig REMOTE -resources.model_serving_endpoints.*.endpoint_details.config.served_entities[*].external_model.google_cloud_vertex_ai_config.private_key string REMOTE -resources.model_serving_endpoints.*.endpoint_details.config.served_entities[*].external_model.google_cloud_vertex_ai_config.private_key_plaintext string REMOTE -resources.model_serving_endpoints.*.endpoint_details.config.served_entities[*].external_model.google_cloud_vertex_ai_config.project_id string REMOTE -resources.model_serving_endpoints.*.endpoint_details.config.served_entities[*].external_model.google_cloud_vertex_ai_config.region string REMOTE -resources.model_serving_endpoints.*.endpoint_details.config.served_entities[*].external_model.name string REMOTE -resources.model_serving_endpoints.*.endpoint_details.config.served_entities[*].external_model.openai_config *serving.OpenAiConfig REMOTE -resources.model_serving_endpoints.*.endpoint_details.config.served_entities[*].external_model.openai_config.microsoft_entra_client_id string REMOTE -resources.model_serving_endpoints.*.endpoint_details.config.served_entities[*].external_model.openai_config.microsoft_entra_client_secret string REMOTE -resources.model_serving_endpoints.*.endpoint_details.config.served_entities[*].external_model.openai_config.microsoft_entra_client_secret_plaintext string REMOTE -resources.model_serving_endpoints.*.endpoint_details.config.served_entities[*].external_model.openai_config.microsoft_entra_tenant_id string REMOTE -resources.model_serving_endpoints.*.endpoint_details.config.served_entities[*].external_model.openai_config.openai_api_base string REMOTE -resources.model_serving_endpoints.*.endpoint_details.config.served_entities[*].external_model.openai_config.openai_api_key string REMOTE -resources.model_serving_endpoints.*.endpoint_details.config.served_entities[*].external_model.openai_config.openai_api_key_plaintext string REMOTE -resources.model_serving_endpoints.*.endpoint_details.config.served_entities[*].external_model.openai_config.openai_api_type string REMOTE -resources.model_serving_endpoints.*.endpoint_details.config.served_entities[*].external_model.openai_config.openai_api_version string REMOTE -resources.model_serving_endpoints.*.endpoint_details.config.served_entities[*].external_model.openai_config.openai_deployment_name string REMOTE -resources.model_serving_endpoints.*.endpoint_details.config.served_entities[*].external_model.openai_config.openai_organization string REMOTE -resources.model_serving_endpoints.*.endpoint_details.config.served_entities[*].external_model.palm_config *serving.PaLmConfig REMOTE -resources.model_serving_endpoints.*.endpoint_details.config.served_entities[*].external_model.palm_config.palm_api_key string REMOTE -resources.model_serving_endpoints.*.endpoint_details.config.served_entities[*].external_model.palm_config.palm_api_key_plaintext string REMOTE -resources.model_serving_endpoints.*.endpoint_details.config.served_entities[*].external_model.provider serving.ExternalModelProvider REMOTE -resources.model_serving_endpoints.*.endpoint_details.config.served_entities[*].external_model.task string REMOTE -resources.model_serving_endpoints.*.endpoint_details.config.served_entities[*].foundation_model *serving.FoundationModel REMOTE -resources.model_serving_endpoints.*.endpoint_details.config.served_entities[*].foundation_model.description string REMOTE -resources.model_serving_endpoints.*.endpoint_details.config.served_entities[*].foundation_model.display_name string REMOTE -resources.model_serving_endpoints.*.endpoint_details.config.served_entities[*].foundation_model.docs string REMOTE -resources.model_serving_endpoints.*.endpoint_details.config.served_entities[*].foundation_model.name string REMOTE -resources.model_serving_endpoints.*.endpoint_details.config.served_entities[*].instance_profile_arn string REMOTE -resources.model_serving_endpoints.*.endpoint_details.config.served_entities[*].max_provisioned_concurrency int REMOTE -resources.model_serving_endpoints.*.endpoint_details.config.served_entities[*].max_provisioned_throughput int REMOTE -resources.model_serving_endpoints.*.endpoint_details.config.served_entities[*].min_provisioned_concurrency int REMOTE -resources.model_serving_endpoints.*.endpoint_details.config.served_entities[*].min_provisioned_throughput int REMOTE -resources.model_serving_endpoints.*.endpoint_details.config.served_entities[*].name string REMOTE -resources.model_serving_endpoints.*.endpoint_details.config.served_entities[*].provisioned_model_units int64 REMOTE -resources.model_serving_endpoints.*.endpoint_details.config.served_entities[*].scale_to_zero_enabled bool REMOTE -resources.model_serving_endpoints.*.endpoint_details.config.served_entities[*].state *serving.ServedModelState REMOTE -resources.model_serving_endpoints.*.endpoint_details.config.served_entities[*].state.deployment serving.ServedModelStateDeployment REMOTE -resources.model_serving_endpoints.*.endpoint_details.config.served_entities[*].state.deployment_state_message string REMOTE -resources.model_serving_endpoints.*.endpoint_details.config.served_entities[*].workload_size string REMOTE -resources.model_serving_endpoints.*.endpoint_details.config.served_entities[*].workload_type serving.ServingModelWorkloadType REMOTE -resources.model_serving_endpoints.*.endpoint_details.config.served_models []serving.ServedModelOutput REMOTE -resources.model_serving_endpoints.*.endpoint_details.config.served_models[*] serving.ServedModelOutput REMOTE -resources.model_serving_endpoints.*.endpoint_details.config.served_models[*].burst_scaling_enabled bool REMOTE -resources.model_serving_endpoints.*.endpoint_details.config.served_models[*].creation_timestamp int64 REMOTE -resources.model_serving_endpoints.*.endpoint_details.config.served_models[*].creator string REMOTE -resources.model_serving_endpoints.*.endpoint_details.config.served_models[*].environment_vars map[string]string REMOTE -resources.model_serving_endpoints.*.endpoint_details.config.served_models[*].environment_vars.* string REMOTE -resources.model_serving_endpoints.*.endpoint_details.config.served_models[*].instance_profile_arn string REMOTE -resources.model_serving_endpoints.*.endpoint_details.config.served_models[*].max_provisioned_concurrency int REMOTE -resources.model_serving_endpoints.*.endpoint_details.config.served_models[*].min_provisioned_concurrency int REMOTE -resources.model_serving_endpoints.*.endpoint_details.config.served_models[*].model_name string REMOTE -resources.model_serving_endpoints.*.endpoint_details.config.served_models[*].model_version string REMOTE -resources.model_serving_endpoints.*.endpoint_details.config.served_models[*].name string REMOTE -resources.model_serving_endpoints.*.endpoint_details.config.served_models[*].provisioned_model_units int64 REMOTE -resources.model_serving_endpoints.*.endpoint_details.config.served_models[*].scale_to_zero_enabled bool REMOTE -resources.model_serving_endpoints.*.endpoint_details.config.served_models[*].state *serving.ServedModelState REMOTE -resources.model_serving_endpoints.*.endpoint_details.config.served_models[*].state.deployment serving.ServedModelStateDeployment REMOTE -resources.model_serving_endpoints.*.endpoint_details.config.served_models[*].state.deployment_state_message string REMOTE -resources.model_serving_endpoints.*.endpoint_details.config.served_models[*].workload_size string REMOTE -resources.model_serving_endpoints.*.endpoint_details.config.served_models[*].workload_type serving.ServingModelWorkloadType REMOTE -resources.model_serving_endpoints.*.endpoint_details.config.traffic_config *serving.TrafficConfig REMOTE -resources.model_serving_endpoints.*.endpoint_details.config.traffic_config.routes []serving.Route REMOTE -resources.model_serving_endpoints.*.endpoint_details.config.traffic_config.routes[*] serving.Route REMOTE -resources.model_serving_endpoints.*.endpoint_details.config.traffic_config.routes[*].served_entity_name string REMOTE -resources.model_serving_endpoints.*.endpoint_details.config.traffic_config.routes[*].served_model_name string REMOTE -resources.model_serving_endpoints.*.endpoint_details.config.traffic_config.routes[*].traffic_percentage int REMOTE -resources.model_serving_endpoints.*.endpoint_details.creation_timestamp int64 REMOTE -resources.model_serving_endpoints.*.endpoint_details.creator string REMOTE -resources.model_serving_endpoints.*.endpoint_details.data_plane_info *serving.ModelDataPlaneInfo REMOTE -resources.model_serving_endpoints.*.endpoint_details.data_plane_info.query_info *serving.DataPlaneInfo REMOTE -resources.model_serving_endpoints.*.endpoint_details.data_plane_info.query_info.authorization_details string REMOTE -resources.model_serving_endpoints.*.endpoint_details.data_plane_info.query_info.endpoint_url string REMOTE -resources.model_serving_endpoints.*.endpoint_details.description string REMOTE -resources.model_serving_endpoints.*.endpoint_details.email_notifications *serving.EmailNotifications REMOTE -resources.model_serving_endpoints.*.endpoint_details.email_notifications.on_update_failure []string REMOTE -resources.model_serving_endpoints.*.endpoint_details.email_notifications.on_update_failure[*] string REMOTE -resources.model_serving_endpoints.*.endpoint_details.email_notifications.on_update_success []string REMOTE -resources.model_serving_endpoints.*.endpoint_details.email_notifications.on_update_success[*] string REMOTE -resources.model_serving_endpoints.*.endpoint_details.endpoint_url string REMOTE -resources.model_serving_endpoints.*.endpoint_details.id string REMOTE -resources.model_serving_endpoints.*.endpoint_details.last_updated_timestamp int64 REMOTE -resources.model_serving_endpoints.*.endpoint_details.name string REMOTE -resources.model_serving_endpoints.*.endpoint_details.pending_config *serving.EndpointPendingConfig REMOTE -resources.model_serving_endpoints.*.endpoint_details.pending_config.auto_capture_config *serving.AutoCaptureConfigOutput REMOTE -resources.model_serving_endpoints.*.endpoint_details.pending_config.auto_capture_config.catalog_name string REMOTE -resources.model_serving_endpoints.*.endpoint_details.pending_config.auto_capture_config.enabled bool REMOTE -resources.model_serving_endpoints.*.endpoint_details.pending_config.auto_capture_config.schema_name string REMOTE -resources.model_serving_endpoints.*.endpoint_details.pending_config.auto_capture_config.state *serving.AutoCaptureState REMOTE -resources.model_serving_endpoints.*.endpoint_details.pending_config.auto_capture_config.state.payload_table *serving.PayloadTable REMOTE -resources.model_serving_endpoints.*.endpoint_details.pending_config.auto_capture_config.state.payload_table.name string REMOTE -resources.model_serving_endpoints.*.endpoint_details.pending_config.auto_capture_config.state.payload_table.status string REMOTE -resources.model_serving_endpoints.*.endpoint_details.pending_config.auto_capture_config.state.payload_table.status_message string REMOTE -resources.model_serving_endpoints.*.endpoint_details.pending_config.auto_capture_config.table_name_prefix string REMOTE -resources.model_serving_endpoints.*.endpoint_details.pending_config.config_version int REMOTE -resources.model_serving_endpoints.*.endpoint_details.pending_config.served_entities []serving.ServedEntityOutput REMOTE -resources.model_serving_endpoints.*.endpoint_details.pending_config.served_entities[*] serving.ServedEntityOutput REMOTE -resources.model_serving_endpoints.*.endpoint_details.pending_config.served_entities[*].burst_scaling_enabled bool REMOTE -resources.model_serving_endpoints.*.endpoint_details.pending_config.served_entities[*].creation_timestamp int64 REMOTE -resources.model_serving_endpoints.*.endpoint_details.pending_config.served_entities[*].creator string REMOTE -resources.model_serving_endpoints.*.endpoint_details.pending_config.served_entities[*].entity_name string REMOTE -resources.model_serving_endpoints.*.endpoint_details.pending_config.served_entities[*].entity_version string REMOTE -resources.model_serving_endpoints.*.endpoint_details.pending_config.served_entities[*].environment_vars map[string]string REMOTE -resources.model_serving_endpoints.*.endpoint_details.pending_config.served_entities[*].environment_vars.* string REMOTE -resources.model_serving_endpoints.*.endpoint_details.pending_config.served_entities[*].external_model *serving.ExternalModel REMOTE -resources.model_serving_endpoints.*.endpoint_details.pending_config.served_entities[*].external_model.ai21labs_config *serving.Ai21LabsConfig REMOTE -resources.model_serving_endpoints.*.endpoint_details.pending_config.served_entities[*].external_model.ai21labs_config.ai21labs_api_key string REMOTE -resources.model_serving_endpoints.*.endpoint_details.pending_config.served_entities[*].external_model.ai21labs_config.ai21labs_api_key_plaintext string REMOTE -resources.model_serving_endpoints.*.endpoint_details.pending_config.served_entities[*].external_model.amazon_bedrock_config *serving.AmazonBedrockConfig REMOTE -resources.model_serving_endpoints.*.endpoint_details.pending_config.served_entities[*].external_model.amazon_bedrock_config.aws_access_key_id string REMOTE -resources.model_serving_endpoints.*.endpoint_details.pending_config.served_entities[*].external_model.amazon_bedrock_config.aws_access_key_id_plaintext string REMOTE -resources.model_serving_endpoints.*.endpoint_details.pending_config.served_entities[*].external_model.amazon_bedrock_config.aws_region string REMOTE -resources.model_serving_endpoints.*.endpoint_details.pending_config.served_entities[*].external_model.amazon_bedrock_config.aws_secret_access_key string REMOTE -resources.model_serving_endpoints.*.endpoint_details.pending_config.served_entities[*].external_model.amazon_bedrock_config.aws_secret_access_key_plaintext string REMOTE -resources.model_serving_endpoints.*.endpoint_details.pending_config.served_entities[*].external_model.amazon_bedrock_config.bedrock_provider serving.AmazonBedrockConfigBedrockProvider REMOTE -resources.model_serving_endpoints.*.endpoint_details.pending_config.served_entities[*].external_model.amazon_bedrock_config.instance_profile_arn string REMOTE -resources.model_serving_endpoints.*.endpoint_details.pending_config.served_entities[*].external_model.anthropic_config *serving.AnthropicConfig REMOTE -resources.model_serving_endpoints.*.endpoint_details.pending_config.served_entities[*].external_model.anthropic_config.anthropic_api_key string REMOTE -resources.model_serving_endpoints.*.endpoint_details.pending_config.served_entities[*].external_model.anthropic_config.anthropic_api_key_plaintext string REMOTE -resources.model_serving_endpoints.*.endpoint_details.pending_config.served_entities[*].external_model.cohere_config *serving.CohereConfig REMOTE -resources.model_serving_endpoints.*.endpoint_details.pending_config.served_entities[*].external_model.cohere_config.cohere_api_base string REMOTE -resources.model_serving_endpoints.*.endpoint_details.pending_config.served_entities[*].external_model.cohere_config.cohere_api_key string REMOTE -resources.model_serving_endpoints.*.endpoint_details.pending_config.served_entities[*].external_model.cohere_config.cohere_api_key_plaintext string REMOTE -resources.model_serving_endpoints.*.endpoint_details.pending_config.served_entities[*].external_model.custom_provider_config *serving.CustomProviderConfig REMOTE -resources.model_serving_endpoints.*.endpoint_details.pending_config.served_entities[*].external_model.custom_provider_config.api_key_auth *serving.ApiKeyAuth REMOTE -resources.model_serving_endpoints.*.endpoint_details.pending_config.served_entities[*].external_model.custom_provider_config.api_key_auth.key string REMOTE -resources.model_serving_endpoints.*.endpoint_details.pending_config.served_entities[*].external_model.custom_provider_config.api_key_auth.value string REMOTE -resources.model_serving_endpoints.*.endpoint_details.pending_config.served_entities[*].external_model.custom_provider_config.api_key_auth.value_plaintext string REMOTE -resources.model_serving_endpoints.*.endpoint_details.pending_config.served_entities[*].external_model.custom_provider_config.bearer_token_auth *serving.BearerTokenAuth REMOTE -resources.model_serving_endpoints.*.endpoint_details.pending_config.served_entities[*].external_model.custom_provider_config.bearer_token_auth.token string REMOTE -resources.model_serving_endpoints.*.endpoint_details.pending_config.served_entities[*].external_model.custom_provider_config.bearer_token_auth.token_plaintext string REMOTE -resources.model_serving_endpoints.*.endpoint_details.pending_config.served_entities[*].external_model.custom_provider_config.custom_provider_url string REMOTE -resources.model_serving_endpoints.*.endpoint_details.pending_config.served_entities[*].external_model.databricks_model_serving_config *serving.DatabricksModelServingConfig REMOTE -resources.model_serving_endpoints.*.endpoint_details.pending_config.served_entities[*].external_model.databricks_model_serving_config.databricks_api_token string REMOTE -resources.model_serving_endpoints.*.endpoint_details.pending_config.served_entities[*].external_model.databricks_model_serving_config.databricks_api_token_plaintext string REMOTE -resources.model_serving_endpoints.*.endpoint_details.pending_config.served_entities[*].external_model.databricks_model_serving_config.databricks_workspace_url string REMOTE -resources.model_serving_endpoints.*.endpoint_details.pending_config.served_entities[*].external_model.google_cloud_vertex_ai_config *serving.GoogleCloudVertexAiConfig REMOTE -resources.model_serving_endpoints.*.endpoint_details.pending_config.served_entities[*].external_model.google_cloud_vertex_ai_config.private_key string REMOTE -resources.model_serving_endpoints.*.endpoint_details.pending_config.served_entities[*].external_model.google_cloud_vertex_ai_config.private_key_plaintext string REMOTE -resources.model_serving_endpoints.*.endpoint_details.pending_config.served_entities[*].external_model.google_cloud_vertex_ai_config.project_id string REMOTE -resources.model_serving_endpoints.*.endpoint_details.pending_config.served_entities[*].external_model.google_cloud_vertex_ai_config.region string REMOTE -resources.model_serving_endpoints.*.endpoint_details.pending_config.served_entities[*].external_model.name string REMOTE -resources.model_serving_endpoints.*.endpoint_details.pending_config.served_entities[*].external_model.openai_config *serving.OpenAiConfig REMOTE -resources.model_serving_endpoints.*.endpoint_details.pending_config.served_entities[*].external_model.openai_config.microsoft_entra_client_id string REMOTE -resources.model_serving_endpoints.*.endpoint_details.pending_config.served_entities[*].external_model.openai_config.microsoft_entra_client_secret string REMOTE -resources.model_serving_endpoints.*.endpoint_details.pending_config.served_entities[*].external_model.openai_config.microsoft_entra_client_secret_plaintext string REMOTE -resources.model_serving_endpoints.*.endpoint_details.pending_config.served_entities[*].external_model.openai_config.microsoft_entra_tenant_id string REMOTE -resources.model_serving_endpoints.*.endpoint_details.pending_config.served_entities[*].external_model.openai_config.openai_api_base string REMOTE -resources.model_serving_endpoints.*.endpoint_details.pending_config.served_entities[*].external_model.openai_config.openai_api_key string REMOTE -resources.model_serving_endpoints.*.endpoint_details.pending_config.served_entities[*].external_model.openai_config.openai_api_key_plaintext string REMOTE -resources.model_serving_endpoints.*.endpoint_details.pending_config.served_entities[*].external_model.openai_config.openai_api_type string REMOTE -resources.model_serving_endpoints.*.endpoint_details.pending_config.served_entities[*].external_model.openai_config.openai_api_version string REMOTE -resources.model_serving_endpoints.*.endpoint_details.pending_config.served_entities[*].external_model.openai_config.openai_deployment_name string REMOTE -resources.model_serving_endpoints.*.endpoint_details.pending_config.served_entities[*].external_model.openai_config.openai_organization string REMOTE -resources.model_serving_endpoints.*.endpoint_details.pending_config.served_entities[*].external_model.palm_config *serving.PaLmConfig REMOTE -resources.model_serving_endpoints.*.endpoint_details.pending_config.served_entities[*].external_model.palm_config.palm_api_key string REMOTE -resources.model_serving_endpoints.*.endpoint_details.pending_config.served_entities[*].external_model.palm_config.palm_api_key_plaintext string REMOTE -resources.model_serving_endpoints.*.endpoint_details.pending_config.served_entities[*].external_model.provider serving.ExternalModelProvider REMOTE -resources.model_serving_endpoints.*.endpoint_details.pending_config.served_entities[*].external_model.task string REMOTE -resources.model_serving_endpoints.*.endpoint_details.pending_config.served_entities[*].foundation_model *serving.FoundationModel REMOTE -resources.model_serving_endpoints.*.endpoint_details.pending_config.served_entities[*].foundation_model.description string REMOTE -resources.model_serving_endpoints.*.endpoint_details.pending_config.served_entities[*].foundation_model.display_name string REMOTE -resources.model_serving_endpoints.*.endpoint_details.pending_config.served_entities[*].foundation_model.docs string REMOTE -resources.model_serving_endpoints.*.endpoint_details.pending_config.served_entities[*].foundation_model.name string REMOTE -resources.model_serving_endpoints.*.endpoint_details.pending_config.served_entities[*].instance_profile_arn string REMOTE -resources.model_serving_endpoints.*.endpoint_details.pending_config.served_entities[*].max_provisioned_concurrency int REMOTE -resources.model_serving_endpoints.*.endpoint_details.pending_config.served_entities[*].max_provisioned_throughput int REMOTE -resources.model_serving_endpoints.*.endpoint_details.pending_config.served_entities[*].min_provisioned_concurrency int REMOTE -resources.model_serving_endpoints.*.endpoint_details.pending_config.served_entities[*].min_provisioned_throughput int REMOTE -resources.model_serving_endpoints.*.endpoint_details.pending_config.served_entities[*].name string REMOTE -resources.model_serving_endpoints.*.endpoint_details.pending_config.served_entities[*].provisioned_model_units int64 REMOTE -resources.model_serving_endpoints.*.endpoint_details.pending_config.served_entities[*].scale_to_zero_enabled bool REMOTE -resources.model_serving_endpoints.*.endpoint_details.pending_config.served_entities[*].state *serving.ServedModelState REMOTE -resources.model_serving_endpoints.*.endpoint_details.pending_config.served_entities[*].state.deployment serving.ServedModelStateDeployment REMOTE -resources.model_serving_endpoints.*.endpoint_details.pending_config.served_entities[*].state.deployment_state_message string REMOTE -resources.model_serving_endpoints.*.endpoint_details.pending_config.served_entities[*].workload_size string REMOTE -resources.model_serving_endpoints.*.endpoint_details.pending_config.served_entities[*].workload_type serving.ServingModelWorkloadType REMOTE -resources.model_serving_endpoints.*.endpoint_details.pending_config.served_models []serving.ServedModelOutput REMOTE -resources.model_serving_endpoints.*.endpoint_details.pending_config.served_models[*] serving.ServedModelOutput REMOTE -resources.model_serving_endpoints.*.endpoint_details.pending_config.served_models[*].burst_scaling_enabled bool REMOTE -resources.model_serving_endpoints.*.endpoint_details.pending_config.served_models[*].creation_timestamp int64 REMOTE -resources.model_serving_endpoints.*.endpoint_details.pending_config.served_models[*].creator string REMOTE -resources.model_serving_endpoints.*.endpoint_details.pending_config.served_models[*].environment_vars map[string]string REMOTE -resources.model_serving_endpoints.*.endpoint_details.pending_config.served_models[*].environment_vars.* string REMOTE -resources.model_serving_endpoints.*.endpoint_details.pending_config.served_models[*].instance_profile_arn string REMOTE -resources.model_serving_endpoints.*.endpoint_details.pending_config.served_models[*].max_provisioned_concurrency int REMOTE -resources.model_serving_endpoints.*.endpoint_details.pending_config.served_models[*].min_provisioned_concurrency int REMOTE -resources.model_serving_endpoints.*.endpoint_details.pending_config.served_models[*].model_name string REMOTE -resources.model_serving_endpoints.*.endpoint_details.pending_config.served_models[*].model_version string REMOTE -resources.model_serving_endpoints.*.endpoint_details.pending_config.served_models[*].name string REMOTE -resources.model_serving_endpoints.*.endpoint_details.pending_config.served_models[*].provisioned_model_units int64 REMOTE -resources.model_serving_endpoints.*.endpoint_details.pending_config.served_models[*].scale_to_zero_enabled bool REMOTE -resources.model_serving_endpoints.*.endpoint_details.pending_config.served_models[*].state *serving.ServedModelState REMOTE -resources.model_serving_endpoints.*.endpoint_details.pending_config.served_models[*].state.deployment serving.ServedModelStateDeployment REMOTE -resources.model_serving_endpoints.*.endpoint_details.pending_config.served_models[*].state.deployment_state_message string REMOTE -resources.model_serving_endpoints.*.endpoint_details.pending_config.served_models[*].workload_size string REMOTE -resources.model_serving_endpoints.*.endpoint_details.pending_config.served_models[*].workload_type serving.ServingModelWorkloadType REMOTE -resources.model_serving_endpoints.*.endpoint_details.pending_config.start_time int64 REMOTE -resources.model_serving_endpoints.*.endpoint_details.pending_config.traffic_config *serving.TrafficConfig REMOTE -resources.model_serving_endpoints.*.endpoint_details.pending_config.traffic_config.routes []serving.Route REMOTE -resources.model_serving_endpoints.*.endpoint_details.pending_config.traffic_config.routes[*] serving.Route REMOTE -resources.model_serving_endpoints.*.endpoint_details.pending_config.traffic_config.routes[*].served_entity_name string REMOTE -resources.model_serving_endpoints.*.endpoint_details.pending_config.traffic_config.routes[*].served_model_name string REMOTE -resources.model_serving_endpoints.*.endpoint_details.pending_config.traffic_config.routes[*].traffic_percentage int REMOTE -resources.model_serving_endpoints.*.endpoint_details.permission_level serving.ServingEndpointDetailedPermissionLevel REMOTE -resources.model_serving_endpoints.*.endpoint_details.route_optimized bool REMOTE -resources.model_serving_endpoints.*.endpoint_details.state *serving.EndpointState REMOTE -resources.model_serving_endpoints.*.endpoint_details.state.config_update serving.EndpointStateConfigUpdate REMOTE -resources.model_serving_endpoints.*.endpoint_details.state.ready serving.EndpointStateReady REMOTE -resources.model_serving_endpoints.*.endpoint_details.tags []serving.EndpointTag REMOTE -resources.model_serving_endpoints.*.endpoint_details.tags[*] serving.EndpointTag REMOTE -resources.model_serving_endpoints.*.endpoint_details.tags[*].key string REMOTE -resources.model_serving_endpoints.*.endpoint_details.tags[*].value string REMOTE -resources.model_serving_endpoints.*.endpoint_details.task string REMOTE -resources.model_serving_endpoints.*.endpoint_id string REMOTE -resources.model_serving_endpoints.*.id string INPUT -resources.model_serving_endpoints.*.lifecycle resources.Lifecycle INPUT -resources.model_serving_endpoints.*.lifecycle.prevent_destroy bool INPUT -resources.model_serving_endpoints.*.modified_status string INPUT -resources.model_serving_endpoints.*.name string INPUT STATE -resources.model_serving_endpoints.*.rate_limits []serving.RateLimit INPUT STATE -resources.model_serving_endpoints.*.rate_limits[*] serving.RateLimit INPUT STATE -resources.model_serving_endpoints.*.rate_limits[*].calls int64 INPUT STATE -resources.model_serving_endpoints.*.rate_limits[*].key serving.RateLimitKey INPUT STATE -resources.model_serving_endpoints.*.rate_limits[*].renewal_period serving.RateLimitRenewalPeriod INPUT STATE -resources.model_serving_endpoints.*.route_optimized bool INPUT STATE -resources.model_serving_endpoints.*.tags []serving.EndpointTag INPUT STATE -resources.model_serving_endpoints.*.tags[*] serving.EndpointTag INPUT STATE -resources.model_serving_endpoints.*.tags[*].key string INPUT STATE -resources.model_serving_endpoints.*.tags[*].value string INPUT STATE -resources.model_serving_endpoints.*.url string INPUT -resources.model_serving_endpoints.*.permissions.object_id string ALL -resources.model_serving_endpoints.*.permissions[*] dresources.StatePermission ALL -resources.model_serving_endpoints.*.permissions[*].group_name string ALL -resources.model_serving_endpoints.*.permissions[*].level iam.PermissionLevel ALL -resources.model_serving_endpoints.*.permissions[*].service_principal_name string ALL -resources.model_serving_endpoints.*.permissions[*].user_name string ALL -resources.models.*.creation_timestamp int64 REMOTE -resources.models.*.description string ALL -resources.models.*.id string INPUT REMOTE -resources.models.*.last_updated_timestamp int64 REMOTE -resources.models.*.latest_versions []ml.ModelVersion REMOTE -resources.models.*.latest_versions[*] ml.ModelVersion REMOTE -resources.models.*.latest_versions[*].creation_timestamp int64 REMOTE -resources.models.*.latest_versions[*].current_stage string REMOTE -resources.models.*.latest_versions[*].description string REMOTE -resources.models.*.latest_versions[*].last_updated_timestamp int64 REMOTE -resources.models.*.latest_versions[*].name string REMOTE -resources.models.*.latest_versions[*].run_id string REMOTE -resources.models.*.latest_versions[*].run_link string REMOTE -resources.models.*.latest_versions[*].source string REMOTE -resources.models.*.latest_versions[*].status ml.ModelVersionStatus REMOTE -resources.models.*.latest_versions[*].status_message string REMOTE -resources.models.*.latest_versions[*].tags []ml.ModelVersionTag REMOTE -resources.models.*.latest_versions[*].tags[*] ml.ModelVersionTag REMOTE -resources.models.*.latest_versions[*].tags[*].key string REMOTE -resources.models.*.latest_versions[*].tags[*].value string REMOTE -resources.models.*.latest_versions[*].user_id string REMOTE -resources.models.*.latest_versions[*].version string REMOTE -resources.models.*.lifecycle resources.Lifecycle INPUT -resources.models.*.lifecycle.prevent_destroy bool INPUT -resources.models.*.model_id string REMOTE -resources.models.*.modified_status string INPUT -resources.models.*.name string ALL -resources.models.*.permission_level ml.PermissionLevel REMOTE -resources.models.*.tags []ml.ModelTag ALL -resources.models.*.tags[*] ml.ModelTag ALL -resources.models.*.tags[*].key string ALL -resources.models.*.tags[*].value string ALL -resources.models.*.url string INPUT -resources.models.*.user_id string REMOTE -resources.models.*.permissions.object_id string ALL -resources.models.*.permissions[*] dresources.StatePermission ALL -resources.models.*.permissions[*].group_name string ALL -resources.models.*.permissions[*].level iam.PermissionLevel ALL -resources.models.*.permissions[*].service_principal_name string ALL -resources.models.*.permissions[*].user_name string ALL -resources.pipelines.*.allow_duplicate_names bool ALL -resources.pipelines.*.budget_policy_id string ALL -resources.pipelines.*.catalog string ALL -resources.pipelines.*.cause string REMOTE -resources.pipelines.*.channel string ALL -resources.pipelines.*.cluster_id string REMOTE -resources.pipelines.*.clusters []pipelines.PipelineCluster ALL -resources.pipelines.*.clusters[*] pipelines.PipelineCluster ALL -resources.pipelines.*.clusters[*].apply_policy_default_values bool ALL -resources.pipelines.*.clusters[*].autoscale *pipelines.PipelineClusterAutoscale ALL -resources.pipelines.*.clusters[*].autoscale.max_workers int ALL -resources.pipelines.*.clusters[*].autoscale.min_workers int ALL -resources.pipelines.*.clusters[*].autoscale.mode pipelines.PipelineClusterAutoscaleMode ALL -resources.pipelines.*.clusters[*].aws_attributes *compute.AwsAttributes ALL -resources.pipelines.*.clusters[*].aws_attributes.availability compute.AwsAvailability ALL -resources.pipelines.*.clusters[*].aws_attributes.ebs_volume_count int ALL -resources.pipelines.*.clusters[*].aws_attributes.ebs_volume_iops int ALL -resources.pipelines.*.clusters[*].aws_attributes.ebs_volume_size int ALL -resources.pipelines.*.clusters[*].aws_attributes.ebs_volume_throughput int ALL -resources.pipelines.*.clusters[*].aws_attributes.ebs_volume_type compute.EbsVolumeType ALL -resources.pipelines.*.clusters[*].aws_attributes.first_on_demand int ALL -resources.pipelines.*.clusters[*].aws_attributes.instance_profile_arn string ALL -resources.pipelines.*.clusters[*].aws_attributes.spot_bid_price_percent int ALL -resources.pipelines.*.clusters[*].aws_attributes.zone_id string ALL -resources.pipelines.*.clusters[*].azure_attributes *compute.AzureAttributes ALL -resources.pipelines.*.clusters[*].azure_attributes.availability compute.AzureAvailability ALL -resources.pipelines.*.clusters[*].azure_attributes.first_on_demand int ALL -resources.pipelines.*.clusters[*].azure_attributes.log_analytics_info *compute.LogAnalyticsInfo ALL -resources.pipelines.*.clusters[*].azure_attributes.log_analytics_info.log_analytics_primary_key string ALL -resources.pipelines.*.clusters[*].azure_attributes.log_analytics_info.log_analytics_workspace_id string ALL -resources.pipelines.*.clusters[*].azure_attributes.spot_bid_max_price float64 ALL -resources.pipelines.*.clusters[*].cluster_log_conf *compute.ClusterLogConf ALL -resources.pipelines.*.clusters[*].cluster_log_conf.dbfs *compute.DbfsStorageInfo ALL -resources.pipelines.*.clusters[*].cluster_log_conf.dbfs.destination string ALL -resources.pipelines.*.clusters[*].cluster_log_conf.s3 *compute.S3StorageInfo ALL -resources.pipelines.*.clusters[*].cluster_log_conf.s3.canned_acl string ALL -resources.pipelines.*.clusters[*].cluster_log_conf.s3.destination string ALL -resources.pipelines.*.clusters[*].cluster_log_conf.s3.enable_encryption bool ALL -resources.pipelines.*.clusters[*].cluster_log_conf.s3.encryption_type string ALL -resources.pipelines.*.clusters[*].cluster_log_conf.s3.endpoint string ALL -resources.pipelines.*.clusters[*].cluster_log_conf.s3.kms_key string ALL -resources.pipelines.*.clusters[*].cluster_log_conf.s3.region string ALL -resources.pipelines.*.clusters[*].cluster_log_conf.volumes *compute.VolumesStorageInfo ALL -resources.pipelines.*.clusters[*].cluster_log_conf.volumes.destination string ALL -resources.pipelines.*.clusters[*].custom_tags map[string]string ALL -resources.pipelines.*.clusters[*].custom_tags.* string ALL -resources.pipelines.*.clusters[*].driver_instance_pool_id string ALL -resources.pipelines.*.clusters[*].driver_node_type_id string ALL -resources.pipelines.*.clusters[*].enable_local_disk_encryption bool ALL -resources.pipelines.*.clusters[*].gcp_attributes *compute.GcpAttributes ALL -resources.pipelines.*.clusters[*].gcp_attributes.availability compute.GcpAvailability ALL -resources.pipelines.*.clusters[*].gcp_attributes.boot_disk_size int ALL -resources.pipelines.*.clusters[*].gcp_attributes.confidential_compute_type compute.ConfidentialComputeType ALL -resources.pipelines.*.clusters[*].gcp_attributes.first_on_demand int ALL -resources.pipelines.*.clusters[*].gcp_attributes.google_service_account string ALL -resources.pipelines.*.clusters[*].gcp_attributes.local_ssd_count int ALL -resources.pipelines.*.clusters[*].gcp_attributes.use_preemptible_executors bool ALL -resources.pipelines.*.clusters[*].gcp_attributes.zone_id string ALL -resources.pipelines.*.clusters[*].init_scripts []compute.InitScriptInfo ALL -resources.pipelines.*.clusters[*].init_scripts[*] compute.InitScriptInfo ALL -resources.pipelines.*.clusters[*].init_scripts[*].abfss *compute.Adlsgen2Info ALL -resources.pipelines.*.clusters[*].init_scripts[*].abfss.destination string ALL -resources.pipelines.*.clusters[*].init_scripts[*].dbfs *compute.DbfsStorageInfo ALL -resources.pipelines.*.clusters[*].init_scripts[*].dbfs.destination string ALL -resources.pipelines.*.clusters[*].init_scripts[*].file *compute.LocalFileInfo ALL -resources.pipelines.*.clusters[*].init_scripts[*].file.destination string ALL -resources.pipelines.*.clusters[*].init_scripts[*].gcs *compute.GcsStorageInfo ALL -resources.pipelines.*.clusters[*].init_scripts[*].gcs.destination string ALL -resources.pipelines.*.clusters[*].init_scripts[*].s3 *compute.S3StorageInfo ALL -resources.pipelines.*.clusters[*].init_scripts[*].s3.canned_acl string ALL -resources.pipelines.*.clusters[*].init_scripts[*].s3.destination string ALL -resources.pipelines.*.clusters[*].init_scripts[*].s3.enable_encryption bool ALL -resources.pipelines.*.clusters[*].init_scripts[*].s3.encryption_type string ALL -resources.pipelines.*.clusters[*].init_scripts[*].s3.endpoint string ALL -resources.pipelines.*.clusters[*].init_scripts[*].s3.kms_key string ALL -resources.pipelines.*.clusters[*].init_scripts[*].s3.region string ALL -resources.pipelines.*.clusters[*].init_scripts[*].volumes *compute.VolumesStorageInfo ALL -resources.pipelines.*.clusters[*].init_scripts[*].volumes.destination string ALL -resources.pipelines.*.clusters[*].init_scripts[*].workspace *compute.WorkspaceStorageInfo ALL -resources.pipelines.*.clusters[*].init_scripts[*].workspace.destination string ALL -resources.pipelines.*.clusters[*].instance_pool_id string ALL -resources.pipelines.*.clusters[*].label string ALL -resources.pipelines.*.clusters[*].node_type_id string ALL -resources.pipelines.*.clusters[*].num_workers int ALL -resources.pipelines.*.clusters[*].policy_id string ALL -resources.pipelines.*.clusters[*].spark_conf map[string]string ALL -resources.pipelines.*.clusters[*].spark_conf.* string ALL -resources.pipelines.*.clusters[*].spark_env_vars map[string]string ALL -resources.pipelines.*.clusters[*].spark_env_vars.* string ALL -resources.pipelines.*.clusters[*].ssh_public_keys []string ALL -resources.pipelines.*.clusters[*].ssh_public_keys[*] string ALL -resources.pipelines.*.configuration map[string]string ALL -resources.pipelines.*.configuration.* string ALL -resources.pipelines.*.continuous bool ALL -resources.pipelines.*.creator_user_name string REMOTE -resources.pipelines.*.deployment *pipelines.PipelineDeployment ALL -resources.pipelines.*.deployment.kind pipelines.DeploymentKind ALL -resources.pipelines.*.deployment.metadata_file_path string ALL -resources.pipelines.*.development bool ALL -resources.pipelines.*.dry_run bool ALL -resources.pipelines.*.edition string ALL -resources.pipelines.*.effective_budget_policy_id string REMOTE -resources.pipelines.*.effective_publishing_mode pipelines.PublishingMode REMOTE -resources.pipelines.*.environment *pipelines.PipelinesEnvironment ALL -resources.pipelines.*.environment.dependencies []string ALL -resources.pipelines.*.environment.dependencies[*] string ALL -resources.pipelines.*.environment.environment_version string ALL -resources.pipelines.*.event_log *pipelines.EventLogSpec ALL -resources.pipelines.*.event_log.catalog string ALL -resources.pipelines.*.event_log.name string ALL -resources.pipelines.*.event_log.schema string ALL -resources.pipelines.*.filters *pipelines.Filters ALL -resources.pipelines.*.filters.exclude []string ALL -resources.pipelines.*.filters.exclude[*] string ALL -resources.pipelines.*.filters.include []string ALL -resources.pipelines.*.filters.include[*] string ALL -resources.pipelines.*.gateway_definition *pipelines.IngestionGatewayPipelineDefinition ALL -resources.pipelines.*.gateway_definition.connection_id string ALL -resources.pipelines.*.gateway_definition.connection_name string ALL -resources.pipelines.*.gateway_definition.connection_parameters *pipelines.ConnectionParameters ALL -resources.pipelines.*.gateway_definition.connection_parameters.source_catalog string ALL -resources.pipelines.*.gateway_definition.gateway_storage_catalog string ALL -resources.pipelines.*.gateway_definition.gateway_storage_name string ALL -resources.pipelines.*.gateway_definition.gateway_storage_schema string ALL -resources.pipelines.*.health pipelines.GetPipelineResponseHealth REMOTE -resources.pipelines.*.id string ALL -resources.pipelines.*.ingestion_definition *pipelines.IngestionPipelineDefinition ALL -resources.pipelines.*.ingestion_definition.connection_name string ALL -resources.pipelines.*.ingestion_definition.connector_type pipelines.ConnectorType ALL -resources.pipelines.*.ingestion_definition.data_staging_options *pipelines.DataStagingOptions ALL -resources.pipelines.*.ingestion_definition.data_staging_options.catalog_name string ALL -resources.pipelines.*.ingestion_definition.data_staging_options.schema_name string ALL -resources.pipelines.*.ingestion_definition.data_staging_options.volume_name string ALL -resources.pipelines.*.ingestion_definition.full_refresh_window *pipelines.OperationTimeWindow ALL -resources.pipelines.*.ingestion_definition.full_refresh_window.days_of_week []pipelines.DayOfWeek ALL -resources.pipelines.*.ingestion_definition.full_refresh_window.days_of_week[*] pipelines.DayOfWeek ALL -resources.pipelines.*.ingestion_definition.full_refresh_window.start_hour int ALL -resources.pipelines.*.ingestion_definition.full_refresh_window.time_zone_id string ALL -resources.pipelines.*.ingestion_definition.ingest_from_uc_foreign_catalog bool ALL -resources.pipelines.*.ingestion_definition.ingestion_gateway_id string ALL -resources.pipelines.*.ingestion_definition.netsuite_jar_path string ALL -resources.pipelines.*.ingestion_definition.objects []pipelines.IngestionConfig ALL -resources.pipelines.*.ingestion_definition.objects[*] pipelines.IngestionConfig ALL -resources.pipelines.*.ingestion_definition.objects[*].report *pipelines.ReportSpec ALL -resources.pipelines.*.ingestion_definition.objects[*].report.destination_catalog string ALL -resources.pipelines.*.ingestion_definition.objects[*].report.destination_schema string ALL -resources.pipelines.*.ingestion_definition.objects[*].report.destination_table string ALL -resources.pipelines.*.ingestion_definition.objects[*].report.source_url string ALL -resources.pipelines.*.ingestion_definition.objects[*].report.table_configuration *pipelines.TableSpecificConfig ALL -resources.pipelines.*.ingestion_definition.objects[*].report.table_configuration.auto_full_refresh_policy *pipelines.AutoFullRefreshPolicy ALL -resources.pipelines.*.ingestion_definition.objects[*].report.table_configuration.auto_full_refresh_policy.enabled bool ALL -resources.pipelines.*.ingestion_definition.objects[*].report.table_configuration.auto_full_refresh_policy.min_interval_hours int ALL -resources.pipelines.*.ingestion_definition.objects[*].report.table_configuration.exclude_columns []string ALL -resources.pipelines.*.ingestion_definition.objects[*].report.table_configuration.exclude_columns[*] string ALL -resources.pipelines.*.ingestion_definition.objects[*].report.table_configuration.include_columns []string ALL -resources.pipelines.*.ingestion_definition.objects[*].report.table_configuration.include_columns[*] string ALL -resources.pipelines.*.ingestion_definition.objects[*].report.table_configuration.primary_keys []string ALL -resources.pipelines.*.ingestion_definition.objects[*].report.table_configuration.primary_keys[*] string ALL -resources.pipelines.*.ingestion_definition.objects[*].report.table_configuration.query_based_connector_config *pipelines.IngestionPipelineDefinitionTableSpecificConfigQueryBasedConnectorConfig ALL -resources.pipelines.*.ingestion_definition.objects[*].report.table_configuration.query_based_connector_config.cursor_columns []string ALL -resources.pipelines.*.ingestion_definition.objects[*].report.table_configuration.query_based_connector_config.cursor_columns[*] string ALL -resources.pipelines.*.ingestion_definition.objects[*].report.table_configuration.query_based_connector_config.deletion_condition string ALL -resources.pipelines.*.ingestion_definition.objects[*].report.table_configuration.query_based_connector_config.hard_deletion_sync_min_interval_in_seconds int64 ALL -resources.pipelines.*.ingestion_definition.objects[*].report.table_configuration.row_filter string ALL -resources.pipelines.*.ingestion_definition.objects[*].report.table_configuration.salesforce_include_formula_fields bool ALL -resources.pipelines.*.ingestion_definition.objects[*].report.table_configuration.scd_type pipelines.TableSpecificConfigScdType ALL -resources.pipelines.*.ingestion_definition.objects[*].report.table_configuration.sequence_by []string ALL -resources.pipelines.*.ingestion_definition.objects[*].report.table_configuration.sequence_by[*] string ALL -resources.pipelines.*.ingestion_definition.objects[*].report.table_configuration.workday_report_parameters *pipelines.IngestionPipelineDefinitionWorkdayReportParameters ALL -resources.pipelines.*.ingestion_definition.objects[*].report.table_configuration.workday_report_parameters.incremental bool ALL -resources.pipelines.*.ingestion_definition.objects[*].report.table_configuration.workday_report_parameters.parameters map[string]string ALL -resources.pipelines.*.ingestion_definition.objects[*].report.table_configuration.workday_report_parameters.parameters.* string ALL -resources.pipelines.*.ingestion_definition.objects[*].report.table_configuration.workday_report_parameters.report_parameters []pipelines.IngestionPipelineDefinitionWorkdayReportParametersQueryKeyValue ALL -resources.pipelines.*.ingestion_definition.objects[*].report.table_configuration.workday_report_parameters.report_parameters[*] pipelines.IngestionPipelineDefinitionWorkdayReportParametersQueryKeyValue ALL -resources.pipelines.*.ingestion_definition.objects[*].report.table_configuration.workday_report_parameters.report_parameters[*].key string ALL -resources.pipelines.*.ingestion_definition.objects[*].report.table_configuration.workday_report_parameters.report_parameters[*].value string ALL -resources.pipelines.*.ingestion_definition.objects[*].schema *pipelines.SchemaSpec ALL -resources.pipelines.*.ingestion_definition.objects[*].schema.connector_options *pipelines.ConnectorOptions ALL -resources.pipelines.*.ingestion_definition.objects[*].schema.connector_options.confluence_options *pipelines.ConfluenceConnectorOptions ALL -resources.pipelines.*.ingestion_definition.objects[*].schema.connector_options.confluence_options.include_confluence_spaces []string ALL -resources.pipelines.*.ingestion_definition.objects[*].schema.connector_options.confluence_options.include_confluence_spaces[*] string ALL -resources.pipelines.*.ingestion_definition.objects[*].schema.connector_options.gdrive_options *pipelines.GoogleDriveOptions ALL -resources.pipelines.*.ingestion_definition.objects[*].schema.connector_options.gdrive_options.entity_type pipelines.GoogleDriveOptionsGoogleDriveEntityType ALL -resources.pipelines.*.ingestion_definition.objects[*].schema.connector_options.gdrive_options.file_ingestion_options *pipelines.FileIngestionOptions ALL -resources.pipelines.*.ingestion_definition.objects[*].schema.connector_options.gdrive_options.file_ingestion_options.corrupt_record_column string ALL -resources.pipelines.*.ingestion_definition.objects[*].schema.connector_options.gdrive_options.file_ingestion_options.file_filters []pipelines.FileFilter ALL -resources.pipelines.*.ingestion_definition.objects[*].schema.connector_options.gdrive_options.file_ingestion_options.file_filters[*] pipelines.FileFilter ALL -resources.pipelines.*.ingestion_definition.objects[*].schema.connector_options.gdrive_options.file_ingestion_options.file_filters[*].modified_after string ALL -resources.pipelines.*.ingestion_definition.objects[*].schema.connector_options.gdrive_options.file_ingestion_options.file_filters[*].modified_before string ALL -resources.pipelines.*.ingestion_definition.objects[*].schema.connector_options.gdrive_options.file_ingestion_options.file_filters[*].path_filter string ALL -resources.pipelines.*.ingestion_definition.objects[*].schema.connector_options.gdrive_options.file_ingestion_options.format pipelines.FileIngestionOptionsFileFormat ALL -resources.pipelines.*.ingestion_definition.objects[*].schema.connector_options.gdrive_options.file_ingestion_options.format_options map[string]string ALL -resources.pipelines.*.ingestion_definition.objects[*].schema.connector_options.gdrive_options.file_ingestion_options.format_options.* string ALL -resources.pipelines.*.ingestion_definition.objects[*].schema.connector_options.gdrive_options.file_ingestion_options.ignore_corrupt_files bool ALL -resources.pipelines.*.ingestion_definition.objects[*].schema.connector_options.gdrive_options.file_ingestion_options.infer_column_types bool ALL -resources.pipelines.*.ingestion_definition.objects[*].schema.connector_options.gdrive_options.file_ingestion_options.reader_case_sensitive bool ALL -resources.pipelines.*.ingestion_definition.objects[*].schema.connector_options.gdrive_options.file_ingestion_options.rescued_data_column string ALL -resources.pipelines.*.ingestion_definition.objects[*].schema.connector_options.gdrive_options.file_ingestion_options.schema_evolution_mode pipelines.FileIngestionOptionsSchemaEvolutionMode ALL -resources.pipelines.*.ingestion_definition.objects[*].schema.connector_options.gdrive_options.file_ingestion_options.schema_hints string ALL -resources.pipelines.*.ingestion_definition.objects[*].schema.connector_options.gdrive_options.file_ingestion_options.single_variant_column string ALL -resources.pipelines.*.ingestion_definition.objects[*].schema.connector_options.gdrive_options.url string ALL -resources.pipelines.*.ingestion_definition.objects[*].schema.connector_options.google_ads_options *pipelines.GoogleAdsOptions ALL -resources.pipelines.*.ingestion_definition.objects[*].schema.connector_options.google_ads_options.lookback_window_days int ALL -resources.pipelines.*.ingestion_definition.objects[*].schema.connector_options.google_ads_options.manager_account_id string ALL -resources.pipelines.*.ingestion_definition.objects[*].schema.connector_options.google_ads_options.sync_start_date string ALL -resources.pipelines.*.ingestion_definition.objects[*].schema.connector_options.jira_options *pipelines.JiraConnectorOptions ALL -resources.pipelines.*.ingestion_definition.objects[*].schema.connector_options.jira_options.include_jira_spaces []string ALL -resources.pipelines.*.ingestion_definition.objects[*].schema.connector_options.jira_options.include_jira_spaces[*] string ALL -resources.pipelines.*.ingestion_definition.objects[*].schema.connector_options.meta_ads_options *pipelines.MetaMarketingOptions ALL -resources.pipelines.*.ingestion_definition.objects[*].schema.connector_options.meta_ads_options.action_attribution_windows []string ALL -resources.pipelines.*.ingestion_definition.objects[*].schema.connector_options.meta_ads_options.action_attribution_windows[*] string ALL -resources.pipelines.*.ingestion_definition.objects[*].schema.connector_options.meta_ads_options.action_breakdowns []string ALL -resources.pipelines.*.ingestion_definition.objects[*].schema.connector_options.meta_ads_options.action_breakdowns[*] string ALL -resources.pipelines.*.ingestion_definition.objects[*].schema.connector_options.meta_ads_options.action_report_time string ALL -resources.pipelines.*.ingestion_definition.objects[*].schema.connector_options.meta_ads_options.breakdowns []string ALL -resources.pipelines.*.ingestion_definition.objects[*].schema.connector_options.meta_ads_options.breakdowns[*] string ALL -resources.pipelines.*.ingestion_definition.objects[*].schema.connector_options.meta_ads_options.custom_insights_lookback_window int ALL -resources.pipelines.*.ingestion_definition.objects[*].schema.connector_options.meta_ads_options.level string ALL -resources.pipelines.*.ingestion_definition.objects[*].schema.connector_options.meta_ads_options.start_date string ALL -resources.pipelines.*.ingestion_definition.objects[*].schema.connector_options.meta_ads_options.time_increment string ALL -resources.pipelines.*.ingestion_definition.objects[*].schema.connector_options.outlook_options *pipelines.OutlookOptions ALL -resources.pipelines.*.ingestion_definition.objects[*].schema.connector_options.outlook_options.attachment_mode pipelines.OutlookAttachmentMode ALL -resources.pipelines.*.ingestion_definition.objects[*].schema.connector_options.outlook_options.body_format pipelines.OutlookBodyFormat ALL -resources.pipelines.*.ingestion_definition.objects[*].schema.connector_options.outlook_options.folder_filter []string ALL -resources.pipelines.*.ingestion_definition.objects[*].schema.connector_options.outlook_options.folder_filter[*] string ALL -resources.pipelines.*.ingestion_definition.objects[*].schema.connector_options.outlook_options.include_folders []string ALL -resources.pipelines.*.ingestion_definition.objects[*].schema.connector_options.outlook_options.include_folders[*] string ALL -resources.pipelines.*.ingestion_definition.objects[*].schema.connector_options.outlook_options.include_mailboxes []string ALL -resources.pipelines.*.ingestion_definition.objects[*].schema.connector_options.outlook_options.include_mailboxes[*] string ALL -resources.pipelines.*.ingestion_definition.objects[*].schema.connector_options.outlook_options.include_senders []string ALL -resources.pipelines.*.ingestion_definition.objects[*].schema.connector_options.outlook_options.include_senders[*] string ALL -resources.pipelines.*.ingestion_definition.objects[*].schema.connector_options.outlook_options.include_subjects []string ALL -resources.pipelines.*.ingestion_definition.objects[*].schema.connector_options.outlook_options.include_subjects[*] string ALL -resources.pipelines.*.ingestion_definition.objects[*].schema.connector_options.outlook_options.sender_filter []string ALL -resources.pipelines.*.ingestion_definition.objects[*].schema.connector_options.outlook_options.sender_filter[*] string ALL -resources.pipelines.*.ingestion_definition.objects[*].schema.connector_options.outlook_options.start_date string ALL -resources.pipelines.*.ingestion_definition.objects[*].schema.connector_options.outlook_options.subject_filter []string ALL -resources.pipelines.*.ingestion_definition.objects[*].schema.connector_options.outlook_options.subject_filter[*] string ALL -resources.pipelines.*.ingestion_definition.objects[*].schema.connector_options.sharepoint_options *pipelines.SharepointOptions ALL -resources.pipelines.*.ingestion_definition.objects[*].schema.connector_options.sharepoint_options.entity_type pipelines.SharepointOptionsSharepointEntityType ALL -resources.pipelines.*.ingestion_definition.objects[*].schema.connector_options.sharepoint_options.file_ingestion_options *pipelines.FileIngestionOptions ALL -resources.pipelines.*.ingestion_definition.objects[*].schema.connector_options.sharepoint_options.file_ingestion_options.corrupt_record_column string ALL -resources.pipelines.*.ingestion_definition.objects[*].schema.connector_options.sharepoint_options.file_ingestion_options.file_filters []pipelines.FileFilter ALL -resources.pipelines.*.ingestion_definition.objects[*].schema.connector_options.sharepoint_options.file_ingestion_options.file_filters[*] pipelines.FileFilter ALL -resources.pipelines.*.ingestion_definition.objects[*].schema.connector_options.sharepoint_options.file_ingestion_options.file_filters[*].modified_after string ALL -resources.pipelines.*.ingestion_definition.objects[*].schema.connector_options.sharepoint_options.file_ingestion_options.file_filters[*].modified_before string ALL -resources.pipelines.*.ingestion_definition.objects[*].schema.connector_options.sharepoint_options.file_ingestion_options.file_filters[*].path_filter string ALL -resources.pipelines.*.ingestion_definition.objects[*].schema.connector_options.sharepoint_options.file_ingestion_options.format pipelines.FileIngestionOptionsFileFormat ALL -resources.pipelines.*.ingestion_definition.objects[*].schema.connector_options.sharepoint_options.file_ingestion_options.format_options map[string]string ALL -resources.pipelines.*.ingestion_definition.objects[*].schema.connector_options.sharepoint_options.file_ingestion_options.format_options.* string ALL -resources.pipelines.*.ingestion_definition.objects[*].schema.connector_options.sharepoint_options.file_ingestion_options.ignore_corrupt_files bool ALL -resources.pipelines.*.ingestion_definition.objects[*].schema.connector_options.sharepoint_options.file_ingestion_options.infer_column_types bool ALL -resources.pipelines.*.ingestion_definition.objects[*].schema.connector_options.sharepoint_options.file_ingestion_options.reader_case_sensitive bool ALL -resources.pipelines.*.ingestion_definition.objects[*].schema.connector_options.sharepoint_options.file_ingestion_options.rescued_data_column string ALL -resources.pipelines.*.ingestion_definition.objects[*].schema.connector_options.sharepoint_options.file_ingestion_options.schema_evolution_mode pipelines.FileIngestionOptionsSchemaEvolutionMode ALL -resources.pipelines.*.ingestion_definition.objects[*].schema.connector_options.sharepoint_options.file_ingestion_options.schema_hints string ALL -resources.pipelines.*.ingestion_definition.objects[*].schema.connector_options.sharepoint_options.file_ingestion_options.single_variant_column string ALL -resources.pipelines.*.ingestion_definition.objects[*].schema.connector_options.sharepoint_options.url string ALL -resources.pipelines.*.ingestion_definition.objects[*].schema.connector_options.smartsheet_options *pipelines.SmartsheetOptions ALL -resources.pipelines.*.ingestion_definition.objects[*].schema.connector_options.smartsheet_options.enforce_schema bool ALL -resources.pipelines.*.ingestion_definition.objects[*].schema.connector_options.tiktok_ads_options *pipelines.TikTokAdsOptions ALL -resources.pipelines.*.ingestion_definition.objects[*].schema.connector_options.tiktok_ads_options.data_level pipelines.TikTokAdsOptionsTikTokDataLevel ALL -resources.pipelines.*.ingestion_definition.objects[*].schema.connector_options.tiktok_ads_options.dimensions []string ALL -resources.pipelines.*.ingestion_definition.objects[*].schema.connector_options.tiktok_ads_options.dimensions[*] string ALL -resources.pipelines.*.ingestion_definition.objects[*].schema.connector_options.tiktok_ads_options.lookback_window_days int ALL -resources.pipelines.*.ingestion_definition.objects[*].schema.connector_options.tiktok_ads_options.metrics []string ALL -resources.pipelines.*.ingestion_definition.objects[*].schema.connector_options.tiktok_ads_options.metrics[*] string ALL -resources.pipelines.*.ingestion_definition.objects[*].schema.connector_options.tiktok_ads_options.query_lifetime bool ALL -resources.pipelines.*.ingestion_definition.objects[*].schema.connector_options.tiktok_ads_options.report_type pipelines.TikTokAdsOptionsTikTokReportType ALL -resources.pipelines.*.ingestion_definition.objects[*].schema.connector_options.tiktok_ads_options.sync_start_date string ALL -resources.pipelines.*.ingestion_definition.objects[*].schema.connector_options.zendesk_support_options *pipelines.ZendeskSupportOptions ALL -resources.pipelines.*.ingestion_definition.objects[*].schema.connector_options.zendesk_support_options.start_date string ALL -resources.pipelines.*.ingestion_definition.objects[*].schema.destination_catalog string ALL -resources.pipelines.*.ingestion_definition.objects[*].schema.destination_schema string ALL -resources.pipelines.*.ingestion_definition.objects[*].schema.source_catalog string ALL -resources.pipelines.*.ingestion_definition.objects[*].schema.source_schema string ALL -resources.pipelines.*.ingestion_definition.objects[*].schema.table_configuration *pipelines.TableSpecificConfig ALL -resources.pipelines.*.ingestion_definition.objects[*].schema.table_configuration.auto_full_refresh_policy *pipelines.AutoFullRefreshPolicy ALL -resources.pipelines.*.ingestion_definition.objects[*].schema.table_configuration.auto_full_refresh_policy.enabled bool ALL -resources.pipelines.*.ingestion_definition.objects[*].schema.table_configuration.auto_full_refresh_policy.min_interval_hours int ALL -resources.pipelines.*.ingestion_definition.objects[*].schema.table_configuration.exclude_columns []string ALL -resources.pipelines.*.ingestion_definition.objects[*].schema.table_configuration.exclude_columns[*] string ALL -resources.pipelines.*.ingestion_definition.objects[*].schema.table_configuration.include_columns []string ALL -resources.pipelines.*.ingestion_definition.objects[*].schema.table_configuration.include_columns[*] string ALL -resources.pipelines.*.ingestion_definition.objects[*].schema.table_configuration.primary_keys []string ALL -resources.pipelines.*.ingestion_definition.objects[*].schema.table_configuration.primary_keys[*] string ALL -resources.pipelines.*.ingestion_definition.objects[*].schema.table_configuration.query_based_connector_config *pipelines.IngestionPipelineDefinitionTableSpecificConfigQueryBasedConnectorConfig ALL -resources.pipelines.*.ingestion_definition.objects[*].schema.table_configuration.query_based_connector_config.cursor_columns []string ALL -resources.pipelines.*.ingestion_definition.objects[*].schema.table_configuration.query_based_connector_config.cursor_columns[*] string ALL -resources.pipelines.*.ingestion_definition.objects[*].schema.table_configuration.query_based_connector_config.deletion_condition string ALL -resources.pipelines.*.ingestion_definition.objects[*].schema.table_configuration.query_based_connector_config.hard_deletion_sync_min_interval_in_seconds int64 ALL -resources.pipelines.*.ingestion_definition.objects[*].schema.table_configuration.row_filter string ALL -resources.pipelines.*.ingestion_definition.objects[*].schema.table_configuration.salesforce_include_formula_fields bool ALL -resources.pipelines.*.ingestion_definition.objects[*].schema.table_configuration.scd_type pipelines.TableSpecificConfigScdType ALL -resources.pipelines.*.ingestion_definition.objects[*].schema.table_configuration.sequence_by []string ALL -resources.pipelines.*.ingestion_definition.objects[*].schema.table_configuration.sequence_by[*] string ALL -resources.pipelines.*.ingestion_definition.objects[*].schema.table_configuration.workday_report_parameters *pipelines.IngestionPipelineDefinitionWorkdayReportParameters ALL -resources.pipelines.*.ingestion_definition.objects[*].schema.table_configuration.workday_report_parameters.incremental bool ALL -resources.pipelines.*.ingestion_definition.objects[*].schema.table_configuration.workday_report_parameters.parameters map[string]string ALL -resources.pipelines.*.ingestion_definition.objects[*].schema.table_configuration.workday_report_parameters.parameters.* string ALL -resources.pipelines.*.ingestion_definition.objects[*].schema.table_configuration.workday_report_parameters.report_parameters []pipelines.IngestionPipelineDefinitionWorkdayReportParametersQueryKeyValue ALL -resources.pipelines.*.ingestion_definition.objects[*].schema.table_configuration.workday_report_parameters.report_parameters[*] pipelines.IngestionPipelineDefinitionWorkdayReportParametersQueryKeyValue ALL -resources.pipelines.*.ingestion_definition.objects[*].schema.table_configuration.workday_report_parameters.report_parameters[*].key string ALL -resources.pipelines.*.ingestion_definition.objects[*].schema.table_configuration.workday_report_parameters.report_parameters[*].value string ALL -resources.pipelines.*.ingestion_definition.objects[*].table *pipelines.TableSpec ALL -resources.pipelines.*.ingestion_definition.objects[*].table.connector_options *pipelines.ConnectorOptions ALL -resources.pipelines.*.ingestion_definition.objects[*].table.connector_options.confluence_options *pipelines.ConfluenceConnectorOptions ALL -resources.pipelines.*.ingestion_definition.objects[*].table.connector_options.confluence_options.include_confluence_spaces []string ALL -resources.pipelines.*.ingestion_definition.objects[*].table.connector_options.confluence_options.include_confluence_spaces[*] string ALL -resources.pipelines.*.ingestion_definition.objects[*].table.connector_options.gdrive_options *pipelines.GoogleDriveOptions ALL -resources.pipelines.*.ingestion_definition.objects[*].table.connector_options.gdrive_options.entity_type pipelines.GoogleDriveOptionsGoogleDriveEntityType ALL -resources.pipelines.*.ingestion_definition.objects[*].table.connector_options.gdrive_options.file_ingestion_options *pipelines.FileIngestionOptions ALL -resources.pipelines.*.ingestion_definition.objects[*].table.connector_options.gdrive_options.file_ingestion_options.corrupt_record_column string ALL -resources.pipelines.*.ingestion_definition.objects[*].table.connector_options.gdrive_options.file_ingestion_options.file_filters []pipelines.FileFilter ALL -resources.pipelines.*.ingestion_definition.objects[*].table.connector_options.gdrive_options.file_ingestion_options.file_filters[*] pipelines.FileFilter ALL -resources.pipelines.*.ingestion_definition.objects[*].table.connector_options.gdrive_options.file_ingestion_options.file_filters[*].modified_after string ALL -resources.pipelines.*.ingestion_definition.objects[*].table.connector_options.gdrive_options.file_ingestion_options.file_filters[*].modified_before string ALL -resources.pipelines.*.ingestion_definition.objects[*].table.connector_options.gdrive_options.file_ingestion_options.file_filters[*].path_filter string ALL -resources.pipelines.*.ingestion_definition.objects[*].table.connector_options.gdrive_options.file_ingestion_options.format pipelines.FileIngestionOptionsFileFormat ALL -resources.pipelines.*.ingestion_definition.objects[*].table.connector_options.gdrive_options.file_ingestion_options.format_options map[string]string ALL -resources.pipelines.*.ingestion_definition.objects[*].table.connector_options.gdrive_options.file_ingestion_options.format_options.* string ALL -resources.pipelines.*.ingestion_definition.objects[*].table.connector_options.gdrive_options.file_ingestion_options.ignore_corrupt_files bool ALL -resources.pipelines.*.ingestion_definition.objects[*].table.connector_options.gdrive_options.file_ingestion_options.infer_column_types bool ALL -resources.pipelines.*.ingestion_definition.objects[*].table.connector_options.gdrive_options.file_ingestion_options.reader_case_sensitive bool ALL -resources.pipelines.*.ingestion_definition.objects[*].table.connector_options.gdrive_options.file_ingestion_options.rescued_data_column string ALL -resources.pipelines.*.ingestion_definition.objects[*].table.connector_options.gdrive_options.file_ingestion_options.schema_evolution_mode pipelines.FileIngestionOptionsSchemaEvolutionMode ALL -resources.pipelines.*.ingestion_definition.objects[*].table.connector_options.gdrive_options.file_ingestion_options.schema_hints string ALL -resources.pipelines.*.ingestion_definition.objects[*].table.connector_options.gdrive_options.file_ingestion_options.single_variant_column string ALL -resources.pipelines.*.ingestion_definition.objects[*].table.connector_options.gdrive_options.url string ALL -resources.pipelines.*.ingestion_definition.objects[*].table.connector_options.google_ads_options *pipelines.GoogleAdsOptions ALL -resources.pipelines.*.ingestion_definition.objects[*].table.connector_options.google_ads_options.lookback_window_days int ALL -resources.pipelines.*.ingestion_definition.objects[*].table.connector_options.google_ads_options.manager_account_id string ALL -resources.pipelines.*.ingestion_definition.objects[*].table.connector_options.google_ads_options.sync_start_date string ALL -resources.pipelines.*.ingestion_definition.objects[*].table.connector_options.jira_options *pipelines.JiraConnectorOptions ALL -resources.pipelines.*.ingestion_definition.objects[*].table.connector_options.jira_options.include_jira_spaces []string ALL -resources.pipelines.*.ingestion_definition.objects[*].table.connector_options.jira_options.include_jira_spaces[*] string ALL -resources.pipelines.*.ingestion_definition.objects[*].table.connector_options.meta_ads_options *pipelines.MetaMarketingOptions ALL -resources.pipelines.*.ingestion_definition.objects[*].table.connector_options.meta_ads_options.action_attribution_windows []string ALL -resources.pipelines.*.ingestion_definition.objects[*].table.connector_options.meta_ads_options.action_attribution_windows[*] string ALL -resources.pipelines.*.ingestion_definition.objects[*].table.connector_options.meta_ads_options.action_breakdowns []string ALL -resources.pipelines.*.ingestion_definition.objects[*].table.connector_options.meta_ads_options.action_breakdowns[*] string ALL -resources.pipelines.*.ingestion_definition.objects[*].table.connector_options.meta_ads_options.action_report_time string ALL -resources.pipelines.*.ingestion_definition.objects[*].table.connector_options.meta_ads_options.breakdowns []string ALL -resources.pipelines.*.ingestion_definition.objects[*].table.connector_options.meta_ads_options.breakdowns[*] string ALL -resources.pipelines.*.ingestion_definition.objects[*].table.connector_options.meta_ads_options.custom_insights_lookback_window int ALL -resources.pipelines.*.ingestion_definition.objects[*].table.connector_options.meta_ads_options.level string ALL -resources.pipelines.*.ingestion_definition.objects[*].table.connector_options.meta_ads_options.start_date string ALL -resources.pipelines.*.ingestion_definition.objects[*].table.connector_options.meta_ads_options.time_increment string ALL -resources.pipelines.*.ingestion_definition.objects[*].table.connector_options.outlook_options *pipelines.OutlookOptions ALL -resources.pipelines.*.ingestion_definition.objects[*].table.connector_options.outlook_options.attachment_mode pipelines.OutlookAttachmentMode ALL -resources.pipelines.*.ingestion_definition.objects[*].table.connector_options.outlook_options.body_format pipelines.OutlookBodyFormat ALL -resources.pipelines.*.ingestion_definition.objects[*].table.connector_options.outlook_options.folder_filter []string ALL -resources.pipelines.*.ingestion_definition.objects[*].table.connector_options.outlook_options.folder_filter[*] string ALL -resources.pipelines.*.ingestion_definition.objects[*].table.connector_options.outlook_options.include_folders []string ALL -resources.pipelines.*.ingestion_definition.objects[*].table.connector_options.outlook_options.include_folders[*] string ALL -resources.pipelines.*.ingestion_definition.objects[*].table.connector_options.outlook_options.include_mailboxes []string ALL -resources.pipelines.*.ingestion_definition.objects[*].table.connector_options.outlook_options.include_mailboxes[*] string ALL -resources.pipelines.*.ingestion_definition.objects[*].table.connector_options.outlook_options.include_senders []string ALL -resources.pipelines.*.ingestion_definition.objects[*].table.connector_options.outlook_options.include_senders[*] string ALL -resources.pipelines.*.ingestion_definition.objects[*].table.connector_options.outlook_options.include_subjects []string ALL -resources.pipelines.*.ingestion_definition.objects[*].table.connector_options.outlook_options.include_subjects[*] string ALL -resources.pipelines.*.ingestion_definition.objects[*].table.connector_options.outlook_options.sender_filter []string ALL -resources.pipelines.*.ingestion_definition.objects[*].table.connector_options.outlook_options.sender_filter[*] string ALL -resources.pipelines.*.ingestion_definition.objects[*].table.connector_options.outlook_options.start_date string ALL -resources.pipelines.*.ingestion_definition.objects[*].table.connector_options.outlook_options.subject_filter []string ALL -resources.pipelines.*.ingestion_definition.objects[*].table.connector_options.outlook_options.subject_filter[*] string ALL -resources.pipelines.*.ingestion_definition.objects[*].table.connector_options.sharepoint_options *pipelines.SharepointOptions ALL -resources.pipelines.*.ingestion_definition.objects[*].table.connector_options.sharepoint_options.entity_type pipelines.SharepointOptionsSharepointEntityType ALL -resources.pipelines.*.ingestion_definition.objects[*].table.connector_options.sharepoint_options.file_ingestion_options *pipelines.FileIngestionOptions ALL -resources.pipelines.*.ingestion_definition.objects[*].table.connector_options.sharepoint_options.file_ingestion_options.corrupt_record_column string ALL -resources.pipelines.*.ingestion_definition.objects[*].table.connector_options.sharepoint_options.file_ingestion_options.file_filters []pipelines.FileFilter ALL -resources.pipelines.*.ingestion_definition.objects[*].table.connector_options.sharepoint_options.file_ingestion_options.file_filters[*] pipelines.FileFilter ALL -resources.pipelines.*.ingestion_definition.objects[*].table.connector_options.sharepoint_options.file_ingestion_options.file_filters[*].modified_after string ALL -resources.pipelines.*.ingestion_definition.objects[*].table.connector_options.sharepoint_options.file_ingestion_options.file_filters[*].modified_before string ALL -resources.pipelines.*.ingestion_definition.objects[*].table.connector_options.sharepoint_options.file_ingestion_options.file_filters[*].path_filter string ALL -resources.pipelines.*.ingestion_definition.objects[*].table.connector_options.sharepoint_options.file_ingestion_options.format pipelines.FileIngestionOptionsFileFormat ALL -resources.pipelines.*.ingestion_definition.objects[*].table.connector_options.sharepoint_options.file_ingestion_options.format_options map[string]string ALL -resources.pipelines.*.ingestion_definition.objects[*].table.connector_options.sharepoint_options.file_ingestion_options.format_options.* string ALL -resources.pipelines.*.ingestion_definition.objects[*].table.connector_options.sharepoint_options.file_ingestion_options.ignore_corrupt_files bool ALL -resources.pipelines.*.ingestion_definition.objects[*].table.connector_options.sharepoint_options.file_ingestion_options.infer_column_types bool ALL -resources.pipelines.*.ingestion_definition.objects[*].table.connector_options.sharepoint_options.file_ingestion_options.reader_case_sensitive bool ALL -resources.pipelines.*.ingestion_definition.objects[*].table.connector_options.sharepoint_options.file_ingestion_options.rescued_data_column string ALL -resources.pipelines.*.ingestion_definition.objects[*].table.connector_options.sharepoint_options.file_ingestion_options.schema_evolution_mode pipelines.FileIngestionOptionsSchemaEvolutionMode ALL -resources.pipelines.*.ingestion_definition.objects[*].table.connector_options.sharepoint_options.file_ingestion_options.schema_hints string ALL -resources.pipelines.*.ingestion_definition.objects[*].table.connector_options.sharepoint_options.file_ingestion_options.single_variant_column string ALL -resources.pipelines.*.ingestion_definition.objects[*].table.connector_options.sharepoint_options.url string ALL -resources.pipelines.*.ingestion_definition.objects[*].table.connector_options.smartsheet_options *pipelines.SmartsheetOptions ALL -resources.pipelines.*.ingestion_definition.objects[*].table.connector_options.smartsheet_options.enforce_schema bool ALL -resources.pipelines.*.ingestion_definition.objects[*].table.connector_options.tiktok_ads_options *pipelines.TikTokAdsOptions ALL -resources.pipelines.*.ingestion_definition.objects[*].table.connector_options.tiktok_ads_options.data_level pipelines.TikTokAdsOptionsTikTokDataLevel ALL -resources.pipelines.*.ingestion_definition.objects[*].table.connector_options.tiktok_ads_options.dimensions []string ALL -resources.pipelines.*.ingestion_definition.objects[*].table.connector_options.tiktok_ads_options.dimensions[*] string ALL -resources.pipelines.*.ingestion_definition.objects[*].table.connector_options.tiktok_ads_options.lookback_window_days int ALL -resources.pipelines.*.ingestion_definition.objects[*].table.connector_options.tiktok_ads_options.metrics []string ALL -resources.pipelines.*.ingestion_definition.objects[*].table.connector_options.tiktok_ads_options.metrics[*] string ALL -resources.pipelines.*.ingestion_definition.objects[*].table.connector_options.tiktok_ads_options.query_lifetime bool ALL -resources.pipelines.*.ingestion_definition.objects[*].table.connector_options.tiktok_ads_options.report_type pipelines.TikTokAdsOptionsTikTokReportType ALL -resources.pipelines.*.ingestion_definition.objects[*].table.connector_options.tiktok_ads_options.sync_start_date string ALL -resources.pipelines.*.ingestion_definition.objects[*].table.connector_options.zendesk_support_options *pipelines.ZendeskSupportOptions ALL -resources.pipelines.*.ingestion_definition.objects[*].table.connector_options.zendesk_support_options.start_date string ALL -resources.pipelines.*.ingestion_definition.objects[*].table.destination_catalog string ALL -resources.pipelines.*.ingestion_definition.objects[*].table.destination_schema string ALL -resources.pipelines.*.ingestion_definition.objects[*].table.destination_table string ALL -resources.pipelines.*.ingestion_definition.objects[*].table.source_catalog string ALL -resources.pipelines.*.ingestion_definition.objects[*].table.source_schema string ALL -resources.pipelines.*.ingestion_definition.objects[*].table.source_table string ALL -resources.pipelines.*.ingestion_definition.objects[*].table.table_configuration *pipelines.TableSpecificConfig ALL -resources.pipelines.*.ingestion_definition.objects[*].table.table_configuration.auto_full_refresh_policy *pipelines.AutoFullRefreshPolicy ALL -resources.pipelines.*.ingestion_definition.objects[*].table.table_configuration.auto_full_refresh_policy.enabled bool ALL -resources.pipelines.*.ingestion_definition.objects[*].table.table_configuration.auto_full_refresh_policy.min_interval_hours int ALL -resources.pipelines.*.ingestion_definition.objects[*].table.table_configuration.exclude_columns []string ALL -resources.pipelines.*.ingestion_definition.objects[*].table.table_configuration.exclude_columns[*] string ALL -resources.pipelines.*.ingestion_definition.objects[*].table.table_configuration.include_columns []string ALL -resources.pipelines.*.ingestion_definition.objects[*].table.table_configuration.include_columns[*] string ALL -resources.pipelines.*.ingestion_definition.objects[*].table.table_configuration.primary_keys []string ALL -resources.pipelines.*.ingestion_definition.objects[*].table.table_configuration.primary_keys[*] string ALL -resources.pipelines.*.ingestion_definition.objects[*].table.table_configuration.query_based_connector_config *pipelines.IngestionPipelineDefinitionTableSpecificConfigQueryBasedConnectorConfig ALL -resources.pipelines.*.ingestion_definition.objects[*].table.table_configuration.query_based_connector_config.cursor_columns []string ALL -resources.pipelines.*.ingestion_definition.objects[*].table.table_configuration.query_based_connector_config.cursor_columns[*] string ALL -resources.pipelines.*.ingestion_definition.objects[*].table.table_configuration.query_based_connector_config.deletion_condition string ALL -resources.pipelines.*.ingestion_definition.objects[*].table.table_configuration.query_based_connector_config.hard_deletion_sync_min_interval_in_seconds int64 ALL -resources.pipelines.*.ingestion_definition.objects[*].table.table_configuration.row_filter string ALL -resources.pipelines.*.ingestion_definition.objects[*].table.table_configuration.salesforce_include_formula_fields bool ALL -resources.pipelines.*.ingestion_definition.objects[*].table.table_configuration.scd_type pipelines.TableSpecificConfigScdType ALL -resources.pipelines.*.ingestion_definition.objects[*].table.table_configuration.sequence_by []string ALL -resources.pipelines.*.ingestion_definition.objects[*].table.table_configuration.sequence_by[*] string ALL -resources.pipelines.*.ingestion_definition.objects[*].table.table_configuration.workday_report_parameters *pipelines.IngestionPipelineDefinitionWorkdayReportParameters ALL -resources.pipelines.*.ingestion_definition.objects[*].table.table_configuration.workday_report_parameters.incremental bool ALL -resources.pipelines.*.ingestion_definition.objects[*].table.table_configuration.workday_report_parameters.parameters map[string]string ALL -resources.pipelines.*.ingestion_definition.objects[*].table.table_configuration.workday_report_parameters.parameters.* string ALL -resources.pipelines.*.ingestion_definition.objects[*].table.table_configuration.workday_report_parameters.report_parameters []pipelines.IngestionPipelineDefinitionWorkdayReportParametersQueryKeyValue ALL -resources.pipelines.*.ingestion_definition.objects[*].table.table_configuration.workday_report_parameters.report_parameters[*] pipelines.IngestionPipelineDefinitionWorkdayReportParametersQueryKeyValue ALL -resources.pipelines.*.ingestion_definition.objects[*].table.table_configuration.workday_report_parameters.report_parameters[*].key string ALL -resources.pipelines.*.ingestion_definition.objects[*].table.table_configuration.workday_report_parameters.report_parameters[*].value string ALL -resources.pipelines.*.ingestion_definition.source_configurations []pipelines.SourceConfig ALL -resources.pipelines.*.ingestion_definition.source_configurations[*] pipelines.SourceConfig ALL -resources.pipelines.*.ingestion_definition.source_configurations[*].catalog *pipelines.SourceCatalogConfig ALL -resources.pipelines.*.ingestion_definition.source_configurations[*].catalog.postgres *pipelines.PostgresCatalogConfig ALL -resources.pipelines.*.ingestion_definition.source_configurations[*].catalog.postgres.slot_config *pipelines.PostgresSlotConfig ALL -resources.pipelines.*.ingestion_definition.source_configurations[*].catalog.postgres.slot_config.publication_name string ALL -resources.pipelines.*.ingestion_definition.source_configurations[*].catalog.postgres.slot_config.slot_name string ALL -resources.pipelines.*.ingestion_definition.source_configurations[*].catalog.source_catalog string ALL -resources.pipelines.*.ingestion_definition.source_configurations[*].google_ads_config *pipelines.GoogleAdsConfig ALL -resources.pipelines.*.ingestion_definition.source_configurations[*].google_ads_config.manager_account_id string ALL -resources.pipelines.*.ingestion_definition.source_type pipelines.IngestionSourceType ALL -resources.pipelines.*.ingestion_definition.table_configuration *pipelines.TableSpecificConfig ALL -resources.pipelines.*.ingestion_definition.table_configuration.auto_full_refresh_policy *pipelines.AutoFullRefreshPolicy ALL -resources.pipelines.*.ingestion_definition.table_configuration.auto_full_refresh_policy.enabled bool ALL -resources.pipelines.*.ingestion_definition.table_configuration.auto_full_refresh_policy.min_interval_hours int ALL -resources.pipelines.*.ingestion_definition.table_configuration.exclude_columns []string ALL -resources.pipelines.*.ingestion_definition.table_configuration.exclude_columns[*] string ALL -resources.pipelines.*.ingestion_definition.table_configuration.include_columns []string ALL -resources.pipelines.*.ingestion_definition.table_configuration.include_columns[*] string ALL -resources.pipelines.*.ingestion_definition.table_configuration.primary_keys []string ALL -resources.pipelines.*.ingestion_definition.table_configuration.primary_keys[*] string ALL -resources.pipelines.*.ingestion_definition.table_configuration.query_based_connector_config *pipelines.IngestionPipelineDefinitionTableSpecificConfigQueryBasedConnectorConfig ALL -resources.pipelines.*.ingestion_definition.table_configuration.query_based_connector_config.cursor_columns []string ALL -resources.pipelines.*.ingestion_definition.table_configuration.query_based_connector_config.cursor_columns[*] string ALL -resources.pipelines.*.ingestion_definition.table_configuration.query_based_connector_config.deletion_condition string ALL -resources.pipelines.*.ingestion_definition.table_configuration.query_based_connector_config.hard_deletion_sync_min_interval_in_seconds int64 ALL -resources.pipelines.*.ingestion_definition.table_configuration.row_filter string ALL -resources.pipelines.*.ingestion_definition.table_configuration.salesforce_include_formula_fields bool ALL -resources.pipelines.*.ingestion_definition.table_configuration.scd_type pipelines.TableSpecificConfigScdType ALL -resources.pipelines.*.ingestion_definition.table_configuration.sequence_by []string ALL -resources.pipelines.*.ingestion_definition.table_configuration.sequence_by[*] string ALL -resources.pipelines.*.ingestion_definition.table_configuration.workday_report_parameters *pipelines.IngestionPipelineDefinitionWorkdayReportParameters ALL -resources.pipelines.*.ingestion_definition.table_configuration.workday_report_parameters.incremental bool ALL -resources.pipelines.*.ingestion_definition.table_configuration.workday_report_parameters.parameters map[string]string ALL -resources.pipelines.*.ingestion_definition.table_configuration.workday_report_parameters.parameters.* string ALL -resources.pipelines.*.ingestion_definition.table_configuration.workday_report_parameters.report_parameters []pipelines.IngestionPipelineDefinitionWorkdayReportParametersQueryKeyValue ALL -resources.pipelines.*.ingestion_definition.table_configuration.workday_report_parameters.report_parameters[*] pipelines.IngestionPipelineDefinitionWorkdayReportParametersQueryKeyValue ALL -resources.pipelines.*.ingestion_definition.table_configuration.workday_report_parameters.report_parameters[*].key string ALL -resources.pipelines.*.ingestion_definition.table_configuration.workday_report_parameters.report_parameters[*].value string ALL -resources.pipelines.*.last_modified int64 REMOTE -resources.pipelines.*.latest_updates []pipelines.UpdateStateInfo REMOTE -resources.pipelines.*.latest_updates[*] pipelines.UpdateStateInfo REMOTE -resources.pipelines.*.latest_updates[*].creation_time string REMOTE -resources.pipelines.*.latest_updates[*].state pipelines.UpdateStateInfoState REMOTE -resources.pipelines.*.latest_updates[*].update_id string REMOTE -resources.pipelines.*.libraries []pipelines.PipelineLibrary ALL -resources.pipelines.*.libraries[*] pipelines.PipelineLibrary ALL -resources.pipelines.*.libraries[*].file *pipelines.FileLibrary ALL -resources.pipelines.*.libraries[*].file.path string ALL -resources.pipelines.*.libraries[*].glob *pipelines.PathPattern ALL -resources.pipelines.*.libraries[*].glob.include string ALL -resources.pipelines.*.libraries[*].jar string ALL -resources.pipelines.*.libraries[*].maven *compute.MavenLibrary ALL -resources.pipelines.*.libraries[*].maven.coordinates string ALL -resources.pipelines.*.libraries[*].maven.exclusions []string ALL -resources.pipelines.*.libraries[*].maven.exclusions[*] string ALL -resources.pipelines.*.libraries[*].maven.repo string ALL -resources.pipelines.*.libraries[*].notebook *pipelines.NotebookLibrary ALL -resources.pipelines.*.libraries[*].notebook.path string ALL -resources.pipelines.*.libraries[*].whl string ALL -resources.pipelines.*.lifecycle resources.Lifecycle INPUT -resources.pipelines.*.lifecycle.prevent_destroy bool INPUT -resources.pipelines.*.modified_status string INPUT -resources.pipelines.*.name string ALL -resources.pipelines.*.notifications []pipelines.Notifications ALL -resources.pipelines.*.notifications[*] pipelines.Notifications ALL -resources.pipelines.*.notifications[*].alerts []string ALL -resources.pipelines.*.notifications[*].alerts[*] string ALL -resources.pipelines.*.notifications[*].email_recipients []string ALL -resources.pipelines.*.notifications[*].email_recipients[*] string ALL -resources.pipelines.*.photon bool ALL -resources.pipelines.*.pipeline_id string REMOTE -resources.pipelines.*.restart_window *pipelines.RestartWindow ALL -resources.pipelines.*.restart_window.days_of_week []pipelines.DayOfWeek ALL -resources.pipelines.*.restart_window.days_of_week[*] pipelines.DayOfWeek ALL -resources.pipelines.*.restart_window.start_hour int ALL -resources.pipelines.*.restart_window.time_zone_id string ALL -resources.pipelines.*.root_path string ALL -resources.pipelines.*.run_as *pipelines.RunAs ALL -resources.pipelines.*.run_as.service_principal_name string ALL -resources.pipelines.*.run_as.user_name string ALL -resources.pipelines.*.run_as_user_name string REMOTE -resources.pipelines.*.schema string ALL -resources.pipelines.*.serverless bool ALL -resources.pipelines.*.state pipelines.PipelineState REMOTE -resources.pipelines.*.storage string ALL -resources.pipelines.*.tags map[string]string ALL -resources.pipelines.*.tags.* string ALL -resources.pipelines.*.target string ALL -resources.pipelines.*.trigger *pipelines.PipelineTrigger ALL -resources.pipelines.*.trigger.cron *pipelines.CronTrigger ALL -resources.pipelines.*.trigger.cron.quartz_cron_schedule string ALL -resources.pipelines.*.trigger.cron.timezone_id string ALL -resources.pipelines.*.trigger.manual *pipelines.ManualTrigger ALL -resources.pipelines.*.url string INPUT -resources.pipelines.*.usage_policy_id string ALL -resources.pipelines.*.permissions.object_id string ALL -resources.pipelines.*.permissions[*] dresources.StatePermission ALL -resources.pipelines.*.permissions[*].group_name string ALL -resources.pipelines.*.permissions[*].level iam.PermissionLevel ALL -resources.pipelines.*.permissions[*].service_principal_name string ALL -resources.pipelines.*.permissions[*].user_name string ALL -resources.postgres_branches.*.branch_id string ALL -resources.postgres_branches.*.create_time *time.Time REMOTE -resources.postgres_branches.*.expire_time *time.Time ALL -resources.postgres_branches.*.id string INPUT -resources.postgres_branches.*.is_protected bool ALL -resources.postgres_branches.*.lifecycle resources.Lifecycle INPUT -resources.postgres_branches.*.lifecycle.prevent_destroy bool INPUT -resources.postgres_branches.*.modified_status string INPUT -resources.postgres_branches.*.name string REMOTE -resources.postgres_branches.*.no_expiry bool ALL -resources.postgres_branches.*.parent string ALL -resources.postgres_branches.*.replace_existing bool INPUT STATE -resources.postgres_branches.*.source_branch string ALL -resources.postgres_branches.*.source_branch_lsn string ALL -resources.postgres_branches.*.source_branch_time *time.Time ALL -resources.postgres_branches.*.status *postgres.BranchStatus REMOTE -resources.postgres_branches.*.status.branch_id string REMOTE -resources.postgres_branches.*.status.current_state postgres.BranchStatusState REMOTE -resources.postgres_branches.*.status.default bool REMOTE -resources.postgres_branches.*.status.expire_time *time.Time REMOTE -resources.postgres_branches.*.status.is_protected bool REMOTE -resources.postgres_branches.*.status.logical_size_bytes int64 REMOTE -resources.postgres_branches.*.status.pending_state postgres.BranchStatusState REMOTE -resources.postgres_branches.*.status.source_branch string REMOTE -resources.postgres_branches.*.status.source_branch_lsn string REMOTE -resources.postgres_branches.*.status.source_branch_time *time.Time REMOTE -resources.postgres_branches.*.status.state_change_time *time.Time REMOTE -resources.postgres_branches.*.ttl *duration.Duration ALL -resources.postgres_branches.*.uid string REMOTE -resources.postgres_branches.*.update_time *time.Time REMOTE -resources.postgres_branches.*.url string INPUT -resources.postgres_catalogs.*.branch string ALL -resources.postgres_catalogs.*.catalog_id string ALL -resources.postgres_catalogs.*.create_database_if_missing bool ALL -resources.postgres_catalogs.*.create_time *time.Time REMOTE -resources.postgres_catalogs.*.id string INPUT -resources.postgres_catalogs.*.lifecycle resources.Lifecycle INPUT -resources.postgres_catalogs.*.lifecycle.prevent_destroy bool INPUT -resources.postgres_catalogs.*.modified_status string INPUT -resources.postgres_catalogs.*.name string REMOTE -resources.postgres_catalogs.*.postgres_database string ALL -resources.postgres_catalogs.*.status *postgres.CatalogCatalogStatus REMOTE -resources.postgres_catalogs.*.status.branch string REMOTE -resources.postgres_catalogs.*.status.catalog_id string REMOTE -resources.postgres_catalogs.*.status.postgres_database string REMOTE -resources.postgres_catalogs.*.status.project string REMOTE -resources.postgres_catalogs.*.uid string REMOTE -resources.postgres_catalogs.*.update_time *time.Time REMOTE -resources.postgres_catalogs.*.url string INPUT -resources.postgres_endpoints.*.autoscaling_limit_max_cu float64 ALL -resources.postgres_endpoints.*.autoscaling_limit_min_cu float64 ALL -resources.postgres_endpoints.*.create_time *time.Time REMOTE -resources.postgres_endpoints.*.disabled bool ALL -resources.postgres_endpoints.*.endpoint_id string ALL -resources.postgres_endpoints.*.endpoint_type postgres.EndpointType ALL -resources.postgres_endpoints.*.group *postgres.EndpointGroupSpec ALL -resources.postgres_endpoints.*.group.enable_readable_secondaries bool ALL -resources.postgres_endpoints.*.group.max int ALL -resources.postgres_endpoints.*.group.min int ALL -resources.postgres_endpoints.*.id string INPUT -resources.postgres_endpoints.*.lifecycle resources.Lifecycle INPUT -resources.postgres_endpoints.*.lifecycle.prevent_destroy bool INPUT -resources.postgres_endpoints.*.modified_status string INPUT -resources.postgres_endpoints.*.name string REMOTE -resources.postgres_endpoints.*.no_suspension bool ALL -resources.postgres_endpoints.*.parent string ALL -resources.postgres_endpoints.*.replace_existing bool INPUT STATE -resources.postgres_endpoints.*.settings *postgres.EndpointSettings ALL -resources.postgres_endpoints.*.settings.pg_settings map[string]string ALL -resources.postgres_endpoints.*.settings.pg_settings.* string ALL -resources.postgres_endpoints.*.status *postgres.EndpointStatus REMOTE -resources.postgres_endpoints.*.status.autoscaling_limit_max_cu float64 REMOTE -resources.postgres_endpoints.*.status.autoscaling_limit_min_cu float64 REMOTE -resources.postgres_endpoints.*.status.current_state postgres.EndpointStatusState REMOTE -resources.postgres_endpoints.*.status.disabled bool REMOTE -resources.postgres_endpoints.*.status.endpoint_id string REMOTE -resources.postgres_endpoints.*.status.endpoint_type postgres.EndpointType REMOTE -resources.postgres_endpoints.*.status.group *postgres.EndpointGroupStatus REMOTE -resources.postgres_endpoints.*.status.group.enable_readable_secondaries bool REMOTE -resources.postgres_endpoints.*.status.group.max int REMOTE -resources.postgres_endpoints.*.status.group.min int REMOTE -resources.postgres_endpoints.*.status.hosts *postgres.EndpointHosts REMOTE -resources.postgres_endpoints.*.status.hosts.host string REMOTE -resources.postgres_endpoints.*.status.hosts.read_only_host string REMOTE -resources.postgres_endpoints.*.status.pending_state postgres.EndpointStatusState REMOTE -resources.postgres_endpoints.*.status.settings *postgres.EndpointSettings REMOTE -resources.postgres_endpoints.*.status.settings.pg_settings map[string]string REMOTE -resources.postgres_endpoints.*.status.settings.pg_settings.* string REMOTE -resources.postgres_endpoints.*.status.suspend_timeout_duration *duration.Duration REMOTE -resources.postgres_endpoints.*.suspend_timeout_duration *duration.Duration ALL -resources.postgres_endpoints.*.uid string REMOTE -resources.postgres_endpoints.*.update_time *time.Time REMOTE -resources.postgres_endpoints.*.url string INPUT -resources.postgres_projects.*.budget_policy_id string ALL -resources.postgres_projects.*.create_time *time.Time REMOTE -resources.postgres_projects.*.custom_tags []postgres.ProjectCustomTag ALL -resources.postgres_projects.*.custom_tags[*] postgres.ProjectCustomTag ALL -resources.postgres_projects.*.custom_tags[*].key string ALL -resources.postgres_projects.*.custom_tags[*].value string ALL -resources.postgres_projects.*.default_branch string ALL -resources.postgres_projects.*.default_endpoint_settings *postgres.ProjectDefaultEndpointSettings ALL -resources.postgres_projects.*.default_endpoint_settings.autoscaling_limit_max_cu float64 ALL -resources.postgres_projects.*.default_endpoint_settings.autoscaling_limit_min_cu float64 ALL -resources.postgres_projects.*.default_endpoint_settings.no_suspension bool ALL -resources.postgres_projects.*.default_endpoint_settings.pg_settings map[string]string ALL -resources.postgres_projects.*.default_endpoint_settings.pg_settings.* string ALL -resources.postgres_projects.*.default_endpoint_settings.suspend_timeout_duration *duration.Duration ALL -resources.postgres_projects.*.delete_time *time.Time REMOTE -resources.postgres_projects.*.display_name string ALL -resources.postgres_projects.*.enable_pg_native_login bool ALL -resources.postgres_projects.*.history_retention_duration *duration.Duration ALL -resources.postgres_projects.*.id string INPUT -resources.postgres_projects.*.initial_endpoint_spec *postgres.InitialEndpointSpec REMOTE -resources.postgres_projects.*.initial_endpoint_spec.group *postgres.EndpointGroupSpec REMOTE -resources.postgres_projects.*.initial_endpoint_spec.group.enable_readable_secondaries bool REMOTE -resources.postgres_projects.*.initial_endpoint_spec.group.max int REMOTE -resources.postgres_projects.*.initial_endpoint_spec.group.min int REMOTE -resources.postgres_projects.*.lifecycle resources.Lifecycle INPUT -resources.postgres_projects.*.lifecycle.prevent_destroy bool INPUT -resources.postgres_projects.*.modified_status string INPUT -resources.postgres_projects.*.name string REMOTE -resources.postgres_projects.*.pg_version int ALL -resources.postgres_projects.*.project_id string ALL -resources.postgres_projects.*.purge_time *time.Time REMOTE -resources.postgres_projects.*.status *postgres.ProjectStatus REMOTE -resources.postgres_projects.*.status.branch_logical_size_limit_bytes int64 REMOTE -resources.postgres_projects.*.status.budget_policy_id string REMOTE -resources.postgres_projects.*.status.custom_tags []postgres.ProjectCustomTag REMOTE -resources.postgres_projects.*.status.custom_tags[*] postgres.ProjectCustomTag REMOTE -resources.postgres_projects.*.status.custom_tags[*].key string REMOTE -resources.postgres_projects.*.status.custom_tags[*].value string REMOTE -resources.postgres_projects.*.status.default_branch string REMOTE -resources.postgres_projects.*.status.default_endpoint_settings *postgres.ProjectDefaultEndpointSettings REMOTE -resources.postgres_projects.*.status.default_endpoint_settings.autoscaling_limit_max_cu float64 REMOTE -resources.postgres_projects.*.status.default_endpoint_settings.autoscaling_limit_min_cu float64 REMOTE -resources.postgres_projects.*.status.default_endpoint_settings.no_suspension bool REMOTE -resources.postgres_projects.*.status.default_endpoint_settings.pg_settings map[string]string REMOTE -resources.postgres_projects.*.status.default_endpoint_settings.pg_settings.* string REMOTE -resources.postgres_projects.*.status.default_endpoint_settings.suspend_timeout_duration *duration.Duration REMOTE -resources.postgres_projects.*.status.display_name string REMOTE -resources.postgres_projects.*.status.enable_pg_native_login bool REMOTE -resources.postgres_projects.*.status.history_retention_duration *duration.Duration REMOTE -resources.postgres_projects.*.status.owner string REMOTE -resources.postgres_projects.*.status.pg_version int REMOTE -resources.postgres_projects.*.status.project_id string REMOTE -resources.postgres_projects.*.status.synthetic_storage_size_bytes int64 REMOTE -resources.postgres_projects.*.uid string REMOTE -resources.postgres_projects.*.update_time *time.Time REMOTE -resources.postgres_projects.*.url string INPUT -resources.postgres_projects.*.permissions.object_id string ALL -resources.postgres_projects.*.permissions[*] dresources.StatePermission ALL -resources.postgres_projects.*.permissions[*].group_name string ALL -resources.postgres_projects.*.permissions[*].level iam.PermissionLevel ALL -resources.postgres_projects.*.permissions[*].service_principal_name string ALL -resources.postgres_projects.*.permissions[*].user_name string ALL -resources.postgres_synced_tables.*.branch string ALL -resources.postgres_synced_tables.*.create_database_objects_if_missing bool ALL -resources.postgres_synced_tables.*.create_time *time.Time REMOTE -resources.postgres_synced_tables.*.existing_pipeline_id string ALL -resources.postgres_synced_tables.*.id string INPUT -resources.postgres_synced_tables.*.lifecycle resources.Lifecycle INPUT -resources.postgres_synced_tables.*.lifecycle.prevent_destroy bool INPUT -resources.postgres_synced_tables.*.modified_status string INPUT -resources.postgres_synced_tables.*.name string REMOTE -resources.postgres_synced_tables.*.new_pipeline_spec *postgres.NewPipelineSpec ALL -resources.postgres_synced_tables.*.new_pipeline_spec.budget_policy_id string ALL -resources.postgres_synced_tables.*.new_pipeline_spec.storage_catalog string ALL -resources.postgres_synced_tables.*.new_pipeline_spec.storage_schema string ALL -resources.postgres_synced_tables.*.postgres_database string ALL -resources.postgres_synced_tables.*.primary_key_columns []string ALL -resources.postgres_synced_tables.*.primary_key_columns[*] string ALL -resources.postgres_synced_tables.*.scheduling_policy postgres.SyncedTableSyncedTableSpecSyncedTableSchedulingPolicy ALL -resources.postgres_synced_tables.*.source_table_full_name string ALL -resources.postgres_synced_tables.*.status *postgres.SyncedTableSyncedTableStatus REMOTE -resources.postgres_synced_tables.*.status.detailed_state postgres.SyncedTableState REMOTE -resources.postgres_synced_tables.*.status.last_processed_commit_version int64 REMOTE -resources.postgres_synced_tables.*.status.last_sync *postgres.SyncedTablePosition REMOTE -resources.postgres_synced_tables.*.status.last_sync.delta_table_sync_info *postgres.DeltaTableSyncInfo REMOTE -resources.postgres_synced_tables.*.status.last_sync.delta_table_sync_info.delta_commit_time *time.Time REMOTE -resources.postgres_synced_tables.*.status.last_sync.delta_table_sync_info.delta_commit_version int64 REMOTE -resources.postgres_synced_tables.*.status.last_sync.sync_end_time *time.Time REMOTE -resources.postgres_synced_tables.*.status.last_sync.sync_start_time *time.Time REMOTE -resources.postgres_synced_tables.*.status.last_sync_time *time.Time REMOTE -resources.postgres_synced_tables.*.status.message string REMOTE -resources.postgres_synced_tables.*.status.ongoing_sync_progress *postgres.SyncedTablePipelineProgress REMOTE -resources.postgres_synced_tables.*.status.ongoing_sync_progress.estimated_completion_time_seconds float64 REMOTE -resources.postgres_synced_tables.*.status.ongoing_sync_progress.latest_version_currently_processing int64 REMOTE -resources.postgres_synced_tables.*.status.ongoing_sync_progress.sync_progress_completion float64 REMOTE -resources.postgres_synced_tables.*.status.ongoing_sync_progress.synced_row_count int64 REMOTE -resources.postgres_synced_tables.*.status.ongoing_sync_progress.total_row_count int64 REMOTE -resources.postgres_synced_tables.*.status.pipeline_id string REMOTE -resources.postgres_synced_tables.*.status.project string REMOTE -resources.postgres_synced_tables.*.status.provisioning_phase postgres.ProvisioningPhase REMOTE -resources.postgres_synced_tables.*.status.unity_catalog_provisioning_state postgres.ProvisioningInfoState REMOTE -resources.postgres_synced_tables.*.synced_table_id string ALL -resources.postgres_synced_tables.*.timeseries_key string ALL -resources.postgres_synced_tables.*.uid string REMOTE -resources.postgres_synced_tables.*.url string INPUT -resources.quality_monitors.*.assets_dir string ALL -resources.quality_monitors.*.baseline_table_name string ALL -resources.quality_monitors.*.custom_metrics []catalog.MonitorMetric ALL -resources.quality_monitors.*.custom_metrics[*] catalog.MonitorMetric ALL -resources.quality_monitors.*.custom_metrics[*].definition string ALL -resources.quality_monitors.*.custom_metrics[*].input_columns []string ALL -resources.quality_monitors.*.custom_metrics[*].input_columns[*] string ALL -resources.quality_monitors.*.custom_metrics[*].name string ALL -resources.quality_monitors.*.custom_metrics[*].output_data_type string ALL -resources.quality_monitors.*.custom_metrics[*].type catalog.MonitorMetricType ALL -resources.quality_monitors.*.dashboard_id string REMOTE -resources.quality_monitors.*.data_classification_config *catalog.MonitorDataClassificationConfig ALL -resources.quality_monitors.*.data_classification_config.enabled bool ALL -resources.quality_monitors.*.drift_metrics_table_name string REMOTE -resources.quality_monitors.*.id string INPUT -resources.quality_monitors.*.inference_log *catalog.MonitorInferenceLog ALL -resources.quality_monitors.*.inference_log.granularities []string ALL -resources.quality_monitors.*.inference_log.granularities[*] string ALL -resources.quality_monitors.*.inference_log.label_col string ALL -resources.quality_monitors.*.inference_log.model_id_col string ALL -resources.quality_monitors.*.inference_log.prediction_col string ALL -resources.quality_monitors.*.inference_log.prediction_proba_col string ALL -resources.quality_monitors.*.inference_log.problem_type catalog.MonitorInferenceLogProblemType ALL -resources.quality_monitors.*.inference_log.timestamp_col string ALL -resources.quality_monitors.*.latest_monitor_failure_msg string ALL -resources.quality_monitors.*.lifecycle resources.Lifecycle INPUT -resources.quality_monitors.*.lifecycle.prevent_destroy bool INPUT -resources.quality_monitors.*.modified_status string INPUT -resources.quality_monitors.*.monitor_version int64 REMOTE -resources.quality_monitors.*.notifications *catalog.MonitorNotifications ALL -resources.quality_monitors.*.notifications.on_failure *catalog.MonitorDestination ALL -resources.quality_monitors.*.notifications.on_failure.email_addresses []string ALL -resources.quality_monitors.*.notifications.on_failure.email_addresses[*] string ALL -resources.quality_monitors.*.notifications.on_new_classification_tag_detected *catalog.MonitorDestination ALL -resources.quality_monitors.*.notifications.on_new_classification_tag_detected.email_addresses []string ALL -resources.quality_monitors.*.notifications.on_new_classification_tag_detected.email_addresses[*] string ALL -resources.quality_monitors.*.output_schema_name string ALL -resources.quality_monitors.*.profile_metrics_table_name string REMOTE -resources.quality_monitors.*.schedule *catalog.MonitorCronSchedule ALL -resources.quality_monitors.*.schedule.pause_status catalog.MonitorCronSchedulePauseStatus ALL -resources.quality_monitors.*.schedule.quartz_cron_expression string ALL -resources.quality_monitors.*.schedule.timezone_id string ALL -resources.quality_monitors.*.skip_builtin_dashboard bool INPUT STATE -resources.quality_monitors.*.slicing_exprs []string ALL -resources.quality_monitors.*.slicing_exprs[*] string ALL -resources.quality_monitors.*.snapshot *catalog.MonitorSnapshot ALL -resources.quality_monitors.*.status catalog.MonitorInfoStatus REMOTE -resources.quality_monitors.*.table_name string ALL -resources.quality_monitors.*.time_series *catalog.MonitorTimeSeries ALL -resources.quality_monitors.*.time_series.granularities []string ALL -resources.quality_monitors.*.time_series.granularities[*] string ALL -resources.quality_monitors.*.time_series.timestamp_col string ALL -resources.quality_monitors.*.url string INPUT -resources.quality_monitors.*.warehouse_id string INPUT STATE -resources.registered_models.*.aliases []catalog.RegisteredModelAlias ALL -resources.registered_models.*.aliases[*] catalog.RegisteredModelAlias ALL -resources.registered_models.*.aliases[*].alias_name string ALL -resources.registered_models.*.aliases[*].catalog_name string ALL -resources.registered_models.*.aliases[*].id string ALL -resources.registered_models.*.aliases[*].model_name string ALL -resources.registered_models.*.aliases[*].schema_name string ALL -resources.registered_models.*.aliases[*].version_num int ALL -resources.registered_models.*.browse_only bool ALL -resources.registered_models.*.catalog_name string ALL -resources.registered_models.*.comment string ALL -resources.registered_models.*.created_at int64 ALL -resources.registered_models.*.created_by string ALL -resources.registered_models.*.full_name string ALL -resources.registered_models.*.id string INPUT -resources.registered_models.*.lifecycle resources.Lifecycle INPUT -resources.registered_models.*.lifecycle.prevent_destroy bool INPUT -resources.registered_models.*.metastore_id string ALL -resources.registered_models.*.modified_status string INPUT -resources.registered_models.*.name string ALL -resources.registered_models.*.owner string ALL -resources.registered_models.*.schema_name string ALL -resources.registered_models.*.storage_location string ALL -resources.registered_models.*.updated_at int64 ALL -resources.registered_models.*.updated_by string ALL -resources.registered_models.*.url string INPUT -resources.registered_models.*.grants.full_name string ALL -resources.registered_models.*.grants.securable_type string ALL -resources.registered_models.*.grants[*] catalog.PrivilegeAssignment ALL -resources.registered_models.*.grants[*].principal string ALL -resources.registered_models.*.grants[*].privileges []catalog.Privilege ALL -resources.registered_models.*.grants[*].privileges[*] catalog.Privilege ALL -resources.schemas.*.browse_only bool REMOTE -resources.schemas.*.catalog_name string ALL -resources.schemas.*.catalog_type catalog.CatalogType REMOTE -resources.schemas.*.comment string ALL -resources.schemas.*.created_at int64 REMOTE -resources.schemas.*.created_by string REMOTE -resources.schemas.*.effective_predictive_optimization_flag *catalog.EffectivePredictiveOptimizationFlag REMOTE -resources.schemas.*.effective_predictive_optimization_flag.inherited_from_name string REMOTE -resources.schemas.*.effective_predictive_optimization_flag.inherited_from_type catalog.EffectivePredictiveOptimizationFlagInheritedFromType REMOTE -resources.schemas.*.effective_predictive_optimization_flag.value catalog.EnablePredictiveOptimization REMOTE -resources.schemas.*.enable_predictive_optimization catalog.EnablePredictiveOptimization REMOTE -resources.schemas.*.full_name string REMOTE -resources.schemas.*.id string INPUT -resources.schemas.*.lifecycle resources.Lifecycle INPUT -resources.schemas.*.lifecycle.prevent_destroy bool INPUT -resources.schemas.*.metastore_id string REMOTE -resources.schemas.*.modified_status string INPUT -resources.schemas.*.name string ALL -resources.schemas.*.owner string REMOTE -resources.schemas.*.properties map[string]string ALL -resources.schemas.*.properties.* string ALL -resources.schemas.*.schema_id string REMOTE -resources.schemas.*.storage_location string REMOTE -resources.schemas.*.storage_root string ALL -resources.schemas.*.updated_at int64 REMOTE -resources.schemas.*.updated_by string REMOTE -resources.schemas.*.url string INPUT -resources.schemas.*.grants.full_name string ALL -resources.schemas.*.grants.securable_type string ALL -resources.schemas.*.grants[*] catalog.PrivilegeAssignment ALL -resources.schemas.*.grants[*].principal string ALL -resources.schemas.*.grants[*].privileges []catalog.Privilege ALL -resources.schemas.*.grants[*].privileges[*] catalog.Privilege ALL -resources.secret_scopes.*.backend_azure_keyvault *workspace.AzureKeyVaultSecretScopeMetadata STATE -resources.secret_scopes.*.backend_azure_keyvault.dns_name string STATE -resources.secret_scopes.*.backend_azure_keyvault.resource_id string STATE -resources.secret_scopes.*.backend_type workspace.ScopeBackendType INPUT REMOTE -resources.secret_scopes.*.id string INPUT -resources.secret_scopes.*.initial_manage_principal string STATE -resources.secret_scopes.*.keyvault_metadata *workspace.AzureKeyVaultSecretScopeMetadata INPUT REMOTE -resources.secret_scopes.*.keyvault_metadata.dns_name string INPUT REMOTE -resources.secret_scopes.*.keyvault_metadata.resource_id string INPUT REMOTE -resources.secret_scopes.*.lifecycle resources.Lifecycle INPUT -resources.secret_scopes.*.lifecycle.prevent_destroy bool INPUT -resources.secret_scopes.*.modified_status string INPUT -resources.secret_scopes.*.name string INPUT REMOTE -resources.secret_scopes.*.scope string STATE -resources.secret_scopes.*.scope_backend_type workspace.ScopeBackendType STATE -resources.secret_scopes.*.url string INPUT -resources.secret_scopes.*.permissions.acls []workspace.AclItem ALL -resources.secret_scopes.*.permissions.acls[*] workspace.AclItem ALL -resources.secret_scopes.*.permissions.acls[*].permission workspace.AclPermission ALL -resources.secret_scopes.*.permissions.acls[*].principal string ALL -resources.secret_scopes.*.permissions.scope_name string ALL -resources.sql_warehouses.*.auto_stop_mins int ALL -resources.sql_warehouses.*.channel *sql.Channel ALL -resources.sql_warehouses.*.channel.dbsql_version string ALL -resources.sql_warehouses.*.channel.name sql.ChannelName ALL -resources.sql_warehouses.*.cluster_size string ALL -resources.sql_warehouses.*.creator_name string ALL -resources.sql_warehouses.*.enable_photon bool ALL -resources.sql_warehouses.*.enable_serverless_compute bool ALL -resources.sql_warehouses.*.health *sql.EndpointHealth REMOTE -resources.sql_warehouses.*.health.details string REMOTE -resources.sql_warehouses.*.health.failure_reason *sql.TerminationReason REMOTE -resources.sql_warehouses.*.health.failure_reason.code sql.TerminationReasonCode REMOTE -resources.sql_warehouses.*.health.failure_reason.parameters map[string]string REMOTE -resources.sql_warehouses.*.health.failure_reason.parameters.* string REMOTE -resources.sql_warehouses.*.health.failure_reason.type sql.TerminationReasonType REMOTE -resources.sql_warehouses.*.health.message string REMOTE -resources.sql_warehouses.*.health.status sql.Status REMOTE -resources.sql_warehouses.*.health.summary string REMOTE -resources.sql_warehouses.*.id string INPUT REMOTE -resources.sql_warehouses.*.instance_profile_arn string ALL -resources.sql_warehouses.*.jdbc_url string REMOTE -resources.sql_warehouses.*.lifecycle resources.Lifecycle INPUT -resources.sql_warehouses.*.lifecycle.prevent_destroy bool INPUT -resources.sql_warehouses.*.max_num_clusters int ALL -resources.sql_warehouses.*.min_num_clusters int ALL -resources.sql_warehouses.*.modified_status string INPUT -resources.sql_warehouses.*.name string ALL -resources.sql_warehouses.*.num_active_sessions int64 REMOTE -resources.sql_warehouses.*.num_clusters int REMOTE -resources.sql_warehouses.*.odbc_params *sql.OdbcParams REMOTE -resources.sql_warehouses.*.odbc_params.hostname string REMOTE -resources.sql_warehouses.*.odbc_params.path string REMOTE -resources.sql_warehouses.*.odbc_params.port int REMOTE -resources.sql_warehouses.*.odbc_params.protocol string REMOTE -resources.sql_warehouses.*.spot_instance_policy sql.SpotInstancePolicy ALL -resources.sql_warehouses.*.state sql.State REMOTE -resources.sql_warehouses.*.tags *sql.EndpointTags ALL -resources.sql_warehouses.*.tags.custom_tags []sql.EndpointTagPair ALL -resources.sql_warehouses.*.tags.custom_tags[*] sql.EndpointTagPair ALL -resources.sql_warehouses.*.tags.custom_tags[*].key string ALL -resources.sql_warehouses.*.tags.custom_tags[*].value string ALL -resources.sql_warehouses.*.url string INPUT -resources.sql_warehouses.*.warehouse_type sql.CreateWarehouseRequestWarehouseType INPUT STATE -resources.sql_warehouses.*.warehouse_type sql.GetWarehouseResponseWarehouseType REMOTE -resources.sql_warehouses.*.permissions.object_id string ALL -resources.sql_warehouses.*.permissions[*] dresources.StatePermission ALL -resources.sql_warehouses.*.permissions[*].group_name string ALL -resources.sql_warehouses.*.permissions[*].level iam.PermissionLevel ALL -resources.sql_warehouses.*.permissions[*].service_principal_name string ALL -resources.sql_warehouses.*.permissions[*].user_name string ALL -resources.synced_database_tables.*.data_synchronization_status *database.SyncedTableStatus ALL -resources.synced_database_tables.*.data_synchronization_status.continuous_update_status *database.SyncedTableContinuousUpdateStatus ALL -resources.synced_database_tables.*.data_synchronization_status.continuous_update_status.initial_pipeline_sync_progress *database.SyncedTablePipelineProgress ALL -resources.synced_database_tables.*.data_synchronization_status.continuous_update_status.initial_pipeline_sync_progress.estimated_completion_time_seconds float64 ALL -resources.synced_database_tables.*.data_synchronization_status.continuous_update_status.initial_pipeline_sync_progress.latest_version_currently_processing int64 ALL -resources.synced_database_tables.*.data_synchronization_status.continuous_update_status.initial_pipeline_sync_progress.provisioning_phase database.ProvisioningPhase ALL -resources.synced_database_tables.*.data_synchronization_status.continuous_update_status.initial_pipeline_sync_progress.sync_progress_completion float64 ALL -resources.synced_database_tables.*.data_synchronization_status.continuous_update_status.initial_pipeline_sync_progress.synced_row_count int64 ALL -resources.synced_database_tables.*.data_synchronization_status.continuous_update_status.initial_pipeline_sync_progress.total_row_count int64 ALL -resources.synced_database_tables.*.data_synchronization_status.continuous_update_status.last_processed_commit_version int64 ALL -resources.synced_database_tables.*.data_synchronization_status.continuous_update_status.timestamp string ALL -resources.synced_database_tables.*.data_synchronization_status.detailed_state database.SyncedTableState ALL -resources.synced_database_tables.*.data_synchronization_status.failed_status *database.SyncedTableFailedStatus ALL -resources.synced_database_tables.*.data_synchronization_status.failed_status.last_processed_commit_version int64 ALL -resources.synced_database_tables.*.data_synchronization_status.failed_status.timestamp string ALL -resources.synced_database_tables.*.data_synchronization_status.last_sync *database.SyncedTablePosition ALL -resources.synced_database_tables.*.data_synchronization_status.last_sync.delta_table_sync_info *database.DeltaTableSyncInfo ALL -resources.synced_database_tables.*.data_synchronization_status.last_sync.delta_table_sync_info.delta_commit_timestamp string ALL -resources.synced_database_tables.*.data_synchronization_status.last_sync.delta_table_sync_info.delta_commit_version int64 ALL -resources.synced_database_tables.*.data_synchronization_status.last_sync.sync_end_timestamp string ALL -resources.synced_database_tables.*.data_synchronization_status.last_sync.sync_start_timestamp string ALL -resources.synced_database_tables.*.data_synchronization_status.message string ALL -resources.synced_database_tables.*.data_synchronization_status.pipeline_id string ALL -resources.synced_database_tables.*.data_synchronization_status.provisioning_status *database.SyncedTableProvisioningStatus ALL -resources.synced_database_tables.*.data_synchronization_status.provisioning_status.initial_pipeline_sync_progress *database.SyncedTablePipelineProgress ALL -resources.synced_database_tables.*.data_synchronization_status.provisioning_status.initial_pipeline_sync_progress.estimated_completion_time_seconds float64 ALL -resources.synced_database_tables.*.data_synchronization_status.provisioning_status.initial_pipeline_sync_progress.latest_version_currently_processing int64 ALL -resources.synced_database_tables.*.data_synchronization_status.provisioning_status.initial_pipeline_sync_progress.provisioning_phase database.ProvisioningPhase ALL -resources.synced_database_tables.*.data_synchronization_status.provisioning_status.initial_pipeline_sync_progress.sync_progress_completion float64 ALL -resources.synced_database_tables.*.data_synchronization_status.provisioning_status.initial_pipeline_sync_progress.synced_row_count int64 ALL -resources.synced_database_tables.*.data_synchronization_status.provisioning_status.initial_pipeline_sync_progress.total_row_count int64 ALL -resources.synced_database_tables.*.data_synchronization_status.triggered_update_status *database.SyncedTableTriggeredUpdateStatus ALL -resources.synced_database_tables.*.data_synchronization_status.triggered_update_status.last_processed_commit_version int64 ALL -resources.synced_database_tables.*.data_synchronization_status.triggered_update_status.timestamp string ALL -resources.synced_database_tables.*.data_synchronization_status.triggered_update_status.triggered_update_progress *database.SyncedTablePipelineProgress ALL -resources.synced_database_tables.*.data_synchronization_status.triggered_update_status.triggered_update_progress.estimated_completion_time_seconds float64 ALL -resources.synced_database_tables.*.data_synchronization_status.triggered_update_status.triggered_update_progress.latest_version_currently_processing int64 ALL -resources.synced_database_tables.*.data_synchronization_status.triggered_update_status.triggered_update_progress.provisioning_phase database.ProvisioningPhase ALL -resources.synced_database_tables.*.data_synchronization_status.triggered_update_status.triggered_update_progress.sync_progress_completion float64 ALL -resources.synced_database_tables.*.data_synchronization_status.triggered_update_status.triggered_update_progress.synced_row_count int64 ALL -resources.synced_database_tables.*.data_synchronization_status.triggered_update_status.triggered_update_progress.total_row_count int64 ALL -resources.synced_database_tables.*.database_instance_name string ALL -resources.synced_database_tables.*.effective_database_instance_name string ALL -resources.synced_database_tables.*.effective_logical_database_name string ALL -resources.synced_database_tables.*.id string INPUT -resources.synced_database_tables.*.lifecycle resources.Lifecycle INPUT -resources.synced_database_tables.*.lifecycle.prevent_destroy bool INPUT -resources.synced_database_tables.*.logical_database_name string ALL -resources.synced_database_tables.*.modified_status string INPUT -resources.synced_database_tables.*.name string ALL -resources.synced_database_tables.*.spec *database.SyncedTableSpec ALL -resources.synced_database_tables.*.spec.create_database_objects_if_missing bool ALL -resources.synced_database_tables.*.spec.existing_pipeline_id string ALL -resources.synced_database_tables.*.spec.new_pipeline_spec *database.NewPipelineSpec ALL -resources.synced_database_tables.*.spec.new_pipeline_spec.budget_policy_id string ALL -resources.synced_database_tables.*.spec.new_pipeline_spec.storage_catalog string ALL -resources.synced_database_tables.*.spec.new_pipeline_spec.storage_schema string ALL -resources.synced_database_tables.*.spec.primary_key_columns []string ALL -resources.synced_database_tables.*.spec.primary_key_columns[*] string ALL -resources.synced_database_tables.*.spec.scheduling_policy database.SyncedTableSchedulingPolicy ALL -resources.synced_database_tables.*.spec.source_table_full_name string ALL -resources.synced_database_tables.*.spec.timeseries_key string ALL -resources.synced_database_tables.*.unity_catalog_provisioning_state database.ProvisioningInfoState ALL -resources.synced_database_tables.*.url string INPUT -resources.vector_search_endpoints.*.budget_policy_id string ALL -resources.vector_search_endpoints.*.creation_timestamp int64 REMOTE -resources.vector_search_endpoints.*.creator string REMOTE -resources.vector_search_endpoints.*.custom_tags []vectorsearch.CustomTag REMOTE -resources.vector_search_endpoints.*.custom_tags[*] vectorsearch.CustomTag REMOTE -resources.vector_search_endpoints.*.custom_tags[*].key string REMOTE -resources.vector_search_endpoints.*.custom_tags[*].value string REMOTE -resources.vector_search_endpoints.*.effective_budget_policy_id string REMOTE -resources.vector_search_endpoints.*.endpoint_status *vectorsearch.EndpointStatus REMOTE -resources.vector_search_endpoints.*.endpoint_status.message string REMOTE -resources.vector_search_endpoints.*.endpoint_status.state vectorsearch.EndpointStatusState REMOTE -resources.vector_search_endpoints.*.endpoint_type vectorsearch.EndpointType ALL -resources.vector_search_endpoints.*.endpoint_uuid string REMOTE -resources.vector_search_endpoints.*.id string INPUT REMOTE -resources.vector_search_endpoints.*.last_updated_timestamp int64 REMOTE -resources.vector_search_endpoints.*.last_updated_user string REMOTE -resources.vector_search_endpoints.*.lifecycle resources.Lifecycle INPUT -resources.vector_search_endpoints.*.lifecycle.prevent_destroy bool INPUT -resources.vector_search_endpoints.*.modified_status string INPUT -resources.vector_search_endpoints.*.name string ALL -resources.vector_search_endpoints.*.num_indexes int REMOTE -resources.vector_search_endpoints.*.scaling_info *vectorsearch.EndpointScalingInfo REMOTE -resources.vector_search_endpoints.*.scaling_info.requested_target_qps int64 REMOTE -resources.vector_search_endpoints.*.scaling_info.state vectorsearch.ScalingChangeState REMOTE -resources.vector_search_endpoints.*.target_qps int64 INPUT STATE -resources.vector_search_endpoints.*.url string INPUT -resources.vector_search_endpoints.*.usage_policy_id string INPUT STATE -resources.vector_search_endpoints.*.permissions.object_id string ALL -resources.vector_search_endpoints.*.permissions[*] dresources.StatePermission ALL -resources.vector_search_endpoints.*.permissions[*].group_name string ALL -resources.vector_search_endpoints.*.permissions[*].level iam.PermissionLevel ALL -resources.vector_search_endpoints.*.permissions[*].service_principal_name string ALL -resources.vector_search_endpoints.*.permissions[*].user_name string ALL -resources.volumes.*.access_point string REMOTE -resources.volumes.*.browse_only bool REMOTE -resources.volumes.*.catalog_name string ALL -resources.volumes.*.comment string ALL -resources.volumes.*.created_at int64 REMOTE -resources.volumes.*.created_by string REMOTE -resources.volumes.*.encryption_details *catalog.EncryptionDetails REMOTE -resources.volumes.*.encryption_details.sse_encryption_details *catalog.SseEncryptionDetails REMOTE -resources.volumes.*.encryption_details.sse_encryption_details.algorithm catalog.SseEncryptionDetailsAlgorithm REMOTE -resources.volumes.*.encryption_details.sse_encryption_details.aws_kms_key_arn string REMOTE -resources.volumes.*.full_name string REMOTE -resources.volumes.*.id string INPUT -resources.volumes.*.lifecycle resources.Lifecycle INPUT -resources.volumes.*.lifecycle.prevent_destroy bool INPUT -resources.volumes.*.metastore_id string REMOTE -resources.volumes.*.modified_status string INPUT -resources.volumes.*.name string ALL -resources.volumes.*.owner string REMOTE -resources.volumes.*.schema_name string ALL -resources.volumes.*.storage_location string ALL -resources.volumes.*.updated_at int64 REMOTE -resources.volumes.*.updated_by string REMOTE -resources.volumes.*.url string INPUT -resources.volumes.*.volume_id string REMOTE -resources.volumes.*.volume_type catalog.VolumeType ALL -resources.volumes.*.grants.full_name string ALL -resources.volumes.*.grants.securable_type string ALL -resources.volumes.*.grants[*] catalog.PrivilegeAssignment ALL -resources.volumes.*.grants[*].principal string ALL -resources.volumes.*.grants[*].privileges []catalog.Privilege ALL -resources.volumes.*.grants[*].privileges[*] catalog.Privilege ALL diff --git a/acceptance/bundle/refschema/output.txt b/acceptance/bundle/refschema/output.txt index eadb6bf3b36..6afb35105c9 100644 --- a/acceptance/bundle/refschema/output.txt +++ b/acceptance/bundle/refschema/output.txt @@ -1,22 +1,71 @@ >>> [CLI] bundle debug refschema --help -Dumps all available fields for each resource type by walking the relevant types. Each line is a path to a field, type and set of tags: -- INPUT: field is present in bundle config. -- STATE: field is present in the state of the resource (direct deployment only). -- REMOTE: field is present in the remote state of the resource (direct deployment only). -- ALL: shortcut for all three. +Service for managing bundle deployment metadata. Usage: - databricks bundle debug refschema [flags] + databricks bundle [flags] + databricks bundle [command] + +Available Commands + complete-version Complete a version. + create-deployment Create a deployment. + create-operation Create an operation. + create-version Create a version. + delete-deployment Delete a deployment. + get-deployment Get a deployment. + get-operation Get an operation. + get-resource Get a resource. + get-version Get a version. + heartbeat Send a version heartbeat. + list-deployments List deployments. + list-operations List operations. + list-resources List resources. + list-versions List versions. Flags: - -h, --help help for refschema + -h, --help help for bundle Global Flags: --debug enable debug logging -o, --output type output type: text or json (default text) -p, --profile string ~/.databrickscfg profile -t, --target string bundle target to use (if applicable) - --var strings set values for variables defined in bundle config. Example: --var="foo=bar" + +Use "databricks bundle [command] --help" for more information about a command. >>> [CLI] bundle debug refschema +Error: unknown command "debug" for "databricks bundle" + +Usage: + databricks bundle [flags] + databricks bundle [command] + +Available Commands + complete-version Complete a version. + create-deployment Create a deployment. + create-operation Create an operation. + create-version Create a version. + delete-deployment Delete a deployment. + get-deployment Get a deployment. + get-operation Get an operation. + get-resource Get a resource. + get-version Get a version. + heartbeat Send a version heartbeat. + list-deployments List deployments. + list-operations List operations. + list-resources List resources. + list-versions List versions. + +Flags: + -h, --help help for bundle + +Global Flags: + --debug enable debug logging + -o, --output type output type: text or json (default text) + -p, --profile string ~/.databrickscfg profile + -t, --target string bundle target to use (if applicable) + +Use "databricks bundle [command] --help" for more information about a command. + + +Exit code: 1 diff --git a/acceptance/dbr_test.go b/acceptance/dbr_test.go index 2fe498698a1..4a264eecd53 100644 --- a/acceptance/dbr_test.go +++ b/acceptance/dbr_test.go @@ -14,6 +14,7 @@ import ( "github.com/databricks/cli/libs/filer" "github.com/databricks/databricks-sdk-go" "github.com/databricks/databricks-sdk-go/service/compute" + "github.com/databricks/databricks-sdk-go/service/iam" "github.com/databricks/databricks-sdk-go/service/jobs" "github.com/databricks/databricks-sdk-go/service/workspace" "github.com/google/uuid" @@ -27,7 +28,7 @@ func workspaceTmpDir(ctx context.Context, t *testing.T) string { w, err := databricks.NewWorkspaceClient() require.NoError(t, err) - currentUser, err := w.CurrentUser.Me(ctx) + currentUser, err := w.CurrentUser.Me(ctx, iam.MeRequest{}) require.NoError(t, err) timestamp := time.Now().Format("2006-01-02T15:04:05Z") @@ -79,7 +80,7 @@ func setupDbrTestDir(ctx context.Context, t *testing.T, uniqueID string) (*datab w, err := databricks.NewWorkspaceClient() require.NoError(t, err) - currentUser, err := w.CurrentUser.Me(ctx) + currentUser, err := w.CurrentUser.Me(ctx, iam.MeRequest{}) require.NoError(t, err) // API path (without /Workspace prefix) for workspace API calls. @@ -180,7 +181,7 @@ func runDbrTests(ctx context.Context, t *testing.T, w *databricks.WorkspaceClien t.Fatal("CLOUD_ENV is not set. Please run DBR tests from a CI environment with deco env run.") } - currentUser, err := w.CurrentUser.Me(ctx) + currentUser, err := w.CurrentUser.Me(ctx, iam.MeRequest{}) require.NoError(t, err) // Create debug logs directory diff --git a/acceptance/internal/prepare_server.go b/acceptance/internal/prepare_server.go index 299d48f03ee..4ed3715d77f 100644 --- a/acceptance/internal/prepare_server.go +++ b/acceptance/internal/prepare_server.go @@ -85,7 +85,7 @@ func PrepareServerAndClient(t *testing.T, config TestConfig, logRequests bool, o w, err := databricks.NewWorkspaceClient() require.NoError(t, err) - user, err := w.CurrentUser.Me(t.Context()) + user, err := w.CurrentUser.Me(t.Context(), iam.MeRequest{}) require.NoError(t, err, "Failed to get current user") cfg := w.Config diff --git a/bundle/config/mutator/populate_current_user.go b/bundle/config/mutator/populate_current_user.go index 2a3cc492829..b1ec81b33e8 100644 --- a/bundle/config/mutator/populate_current_user.go +++ b/bundle/config/mutator/populate_current_user.go @@ -31,7 +31,7 @@ func (m *populateCurrentUser) Apply(ctx context.Context, b *bundle.Bundle) diag. fingerprint := b.GetUserFingerprint(ctx) me, err := cache.GetOrCompute(ctx, b.Cache, fingerprint, func(ctx context.Context) (*iam.User, error) { - return w.CurrentUser.Me(ctx) + return w.CurrentUser.Me(ctx, iam.MeRequest{}) }) if err != nil { return diag.FromErr(err) diff --git a/bundle/docsgen/output/reference.md b/bundle/docsgen/output/reference.md index 9d41a86792d..c88824d79ab 100644 --- a/bundle/docsgen/output/reference.md +++ b/bundle/docsgen/output/reference.md @@ -1,7 +1,7 @@ --- description: 'Configuration reference for databricks.yml' last_update: - date: 2026-05-11 + date: 2026-05-21 --- @@ -495,6 +495,10 @@ resources: - Map - See [\_](#resourcespostgres_branches). +- - `postgres_catalogs` + - Map + - The Postgres catalog definitions for the bundle, where each key is the name of the catalog. Each entry binds a Unity Catalog catalog to a Postgres database on a Lakebase Autoscaling branch. See [\_](#resourcespostgres_catalogs). + - - `postgres_endpoints` - Map - See [\_](#resourcespostgres_endpoints). @@ -503,6 +507,10 @@ resources: - Map - See [\_](#resourcespostgres_projects). +- - `postgres_synced_tables` + - Map + - The Postgres synced table definitions for the bundle, where each key is the name of the synced table. Each entry continuously replicates a Unity Catalog Delta source table into a Postgres table on a Lakebase Autoscaling instance. See [\_](#resourcespostgres_synced_tables). + - - `quality_monitors` - Map - The quality monitor definitions for the bundle, where each key is the name of the quality monitor. See [\_](/dev-tools/bundles/resources.md#quality_monitors). @@ -1521,6 +1529,10 @@ postgres_branches: - String - +- - `replace_existing` + - Boolean + - + - - `source_branch` - String - @@ -1548,6 +1560,69 @@ postgres_branches: +:::list-table + +- - Key + - Type + - Description + +- - `prevent_destroy` + - Boolean + - Lifecycle setting to prevent the resource from being destroyed. + +::: + + +### resources.postgres_catalogs + +**`Type: Map`** + +The Postgres catalog definitions for the bundle, where each key is the name of the catalog. Each entry binds a Unity Catalog catalog to a Postgres database on a Lakebase Autoscaling branch. + +```yaml +postgres_catalogs: + : + : +``` + + +:::list-table + +- - Key + - Type + - Description + +- - `branch` + - String + - + +- - `catalog_id` + - String + - + +- - `create_database_if_missing` + - Boolean + - + +- - `lifecycle` + - Map + - See [\_](#resourcespostgres_catalogsnamelifecycle). + +- - `postgres_database` + - String + - + +::: + + +### resources.postgres_catalogs._name_.lifecycle + +**`Type: Map`** + + + + + :::list-table - - Key @@ -1616,6 +1691,10 @@ postgres_endpoints: - String - +- - `replace_existing` + - Boolean + - + - - `settings` - Map - See [\_](#resourcespostgres_endpointsnamesettings). @@ -1768,6 +1847,93 @@ postgres_projects: ::: +### resources.postgres_synced_tables + +**`Type: Map`** + +The Postgres synced table definitions for the bundle, where each key is the name of the synced table. Each entry continuously replicates a Unity Catalog Delta source table into a Postgres table on a Lakebase Autoscaling instance. + +```yaml +postgres_synced_tables: + : + : +``` + + +:::list-table + +- - Key + - Type + - Description + +- - `branch` + - String + - + +- - `create_database_objects_if_missing` + - Boolean + - + +- - `existing_pipeline_id` + - String + - + +- - `lifecycle` + - Map + - See [\_](#resourcespostgres_synced_tablesnamelifecycle). + +- - `new_pipeline_spec` + - Map + - See [\_](#resourcespostgres_synced_tablesnamenew_pipeline_spec). + +- - `postgres_database` + - String + - + +- - `primary_key_columns` + - Sequence + - + +- - `scheduling_policy` + - String + - + +- - `source_table_full_name` + - String + - + +- - `synced_table_id` + - String + - + +- - `timeseries_key` + - String + - + +::: + + +### resources.postgres_synced_tables._name_.lifecycle + +**`Type: Map`** + + + + + +:::list-table + +- - Key + - Type + - Description + +- - `prevent_destroy` + - Boolean + - Lifecycle setting to prevent the resource from being destroyed. + +::: + + ### resources.secret_scopes **`Type: Map`** @@ -2573,6 +2739,10 @@ The resource definitions for the target. - Map - See [\_](#targetsnameresourcespostgres_branches). +- - `postgres_catalogs` + - Map + - The Postgres catalog definitions for the bundle, where each key is the name of the catalog. Each entry binds a Unity Catalog catalog to a Postgres database on a Lakebase Autoscaling branch. See [\_](#targetsnameresourcespostgres_catalogs). + - - `postgres_endpoints` - Map - See [\_](#targetsnameresourcespostgres_endpoints). @@ -2581,6 +2751,10 @@ The resource definitions for the target. - Map - See [\_](#targetsnameresourcespostgres_projects). +- - `postgres_synced_tables` + - Map + - The Postgres synced table definitions for the bundle, where each key is the name of the synced table. Each entry continuously replicates a Unity Catalog Delta source table into a Postgres table on a Lakebase Autoscaling instance. See [\_](#targetsnameresourcespostgres_synced_tables). + - - `quality_monitors` - Map - The quality monitor definitions for the bundle, where each key is the name of the quality monitor. See [\_](/dev-tools/bundles/resources.md#quality_monitors). @@ -3599,6 +3773,10 @@ postgres_branches: - String - +- - `replace_existing` + - Boolean + - + - - `source_branch` - String - @@ -3626,6 +3804,69 @@ postgres_branches: +:::list-table + +- - Key + - Type + - Description + +- - `prevent_destroy` + - Boolean + - Lifecycle setting to prevent the resource from being destroyed. + +::: + + +### targets._name_.resources.postgres_catalogs + +**`Type: Map`** + +The Postgres catalog definitions for the bundle, where each key is the name of the catalog. Each entry binds a Unity Catalog catalog to a Postgres database on a Lakebase Autoscaling branch. + +```yaml +postgres_catalogs: + : + : +``` + + +:::list-table + +- - Key + - Type + - Description + +- - `branch` + - String + - + +- - `catalog_id` + - String + - + +- - `create_database_if_missing` + - Boolean + - + +- - `lifecycle` + - Map + - See [\_](#targetsnameresourcespostgres_catalogsnamelifecycle). + +- - `postgres_database` + - String + - + +::: + + +### targets._name_.resources.postgres_catalogs._name_.lifecycle + +**`Type: Map`** + + + + + :::list-table - - Key @@ -3694,6 +3935,10 @@ postgres_endpoints: - String - +- - `replace_existing` + - Boolean + - + - - `settings` - Map - See [\_](#targetsnameresourcespostgres_endpointsnamesettings). @@ -3846,6 +4091,93 @@ postgres_projects: ::: +### targets._name_.resources.postgres_synced_tables + +**`Type: Map`** + +The Postgres synced table definitions for the bundle, where each key is the name of the synced table. Each entry continuously replicates a Unity Catalog Delta source table into a Postgres table on a Lakebase Autoscaling instance. + +```yaml +postgres_synced_tables: + : + : +``` + + +:::list-table + +- - Key + - Type + - Description + +- - `branch` + - String + - + +- - `create_database_objects_if_missing` + - Boolean + - + +- - `existing_pipeline_id` + - String + - + +- - `lifecycle` + - Map + - See [\_](#targetsnameresourcespostgres_synced_tablesnamelifecycle). + +- - `new_pipeline_spec` + - Map + - See [\_](#targetsnameresourcespostgres_synced_tablesnamenew_pipeline_spec). + +- - `postgres_database` + - String + - + +- - `primary_key_columns` + - Sequence + - + +- - `scheduling_policy` + - String + - + +- - `source_table_full_name` + - String + - + +- - `synced_table_id` + - String + - + +- - `timeseries_key` + - String + - + +::: + + +### targets._name_.resources.postgres_synced_tables._name_.lifecycle + +**`Type: Map`** + + + + + +:::list-table + +- - Key + - Type + - Description + +- - `prevent_destroy` + - Boolean + - Lifecycle setting to prevent the resource from being destroyed. + +::: + + ### targets._name_.resources.secret_scopes **`Type: Map`** diff --git a/bundle/docsgen/output/resources.md b/bundle/docsgen/output/resources.md index 392e574dcd3..1ab8ef813d7 100644 --- a/bundle/docsgen/output/resources.md +++ b/bundle/docsgen/output/resources.md @@ -1,7 +1,7 @@ --- description: 'Learn about resources supported by Declarative Automation Bundles and how to configure them.' last_update: - date: 2026-05-11 + date: 2026-05-21 --- @@ -544,6 +544,10 @@ apps: - String - The description of the app. +- - `git_repository` + - Map + - Git repository configuration for app deployments. When specified, deployments can reference code from this repository by providing only the git reference (branch, tag, or commit). See [\_](#appsnamegit_repository). + - - `git_source` - Map - Git source configuration for app deployments. Specifies which git reference (branch, tag, or commit) to use when deploying the app. Used in conjunction with git_repository to deploy code directly from git. The source_code_path within git_source specifies the relative path to the app code within the repository. See [\_](#appsnamegit_source). @@ -572,10 +576,6 @@ apps: - Sequence - See [\_](#appsnametelemetry_export_destinations). -- - `thumbnail_url` - - String - - - - - `usage_policy_id` - String - @@ -641,6 +641,32 @@ apps: ::: +### apps._name_.git_repository + +**`Type: Map`** + +Git repository configuration for app deployments. When specified, deployments can +reference code from this repository by providing only the git reference (branch, tag, or commit). + + + +:::list-table + +- - Key + - Type + - Description + +- - `provider` + - String + - Git provider. Case insensitive. Supported values: gitHub, gitHubEnterprise, bitbucketCloud, bitbucketServer, azureDevOpsServices, gitLab, gitLabEnterpriseEdition, awsCodeCommit. + +- - `url` + - String + - URL of the Git repository. + +::: + + ### apps._name_.git_source **`Type: Map`** @@ -1154,6 +1180,10 @@ catalogs: - Map - See [\_](#catalogsnamelifecycle). +- - `managed_encryption_settings` + - Map + - Control CMK encryption for managed catalog data. See [\_](#catalogsnamemanaged_encryption_settings). + - - `name` - String - @@ -1234,6 +1264,64 @@ The privileges assigned to the principal. ::: +### catalogs._name_.managed_encryption_settings + +**`Type: Map`** + +Control CMK encryption for managed catalog data + + + +:::list-table + +- - Key + - Type + - Description + +- - `azure_encryption_settings` + - Map + - optional Azure settings - only required if an Azure CMK is used. See [\_](#catalogsnamemanaged_encryption_settingsazure_encryption_settings). + +- - `azure_key_vault_key_id` + - String + - the AKV URL in Azure, null otherwise. + +- - `customer_managed_key_id` + - String + - the CMK uuid in AWS and GCP, null otherwise. + +::: + + +### catalogs._name_.managed_encryption_settings.azure_encryption_settings + +**`Type: Map`** + +optional Azure settings - only required if an Azure CMK is used. + + + +:::list-table + +- - Key + - Type + - Description + +- - `azure_cmk_access_connector_id` + - String + - + +- - `azure_cmk_managed_identity_id` + - String + - + +- - `azure_tenant_id` + - String + - + +::: + + ## clusters **`Type: Map`** @@ -1790,10 +1878,6 @@ If not specified at cluster creation, a set of default values will be used. - Integer - Boot disk size in GB -- - `confidential_compute_type` - - String - - - - - `first_on_demand` - Integer - The first `first_on_demand` nodes of the cluster will be placed on on-demand instances. This value should be greater than 0, to make sure the cluster driver node is placed on an on-demand instance. If this value is greater than or equal to the current cluster size, all nodes will be placed on on-demand instances. If this value is less than the current cluster size, `first_on_demand` nodes will be placed on on-demand instances and the remainder will be placed on `availability` instances. Note that this value does not affect cluster size and cannot currently be mutated over the lifetime of a cluster. @@ -3289,7 +3373,7 @@ For other serverless tasks, the task environment is required to be specified usi - - `spec` - Map - - The environment entity used to preserve serverless environment side panel, jobs' environment for non-notebook task, and DLT's environment for classic and serverless pipelines. In this minimal environment spec, only pip and java dependencies are supported. See [\_](#jobsnameenvironmentsspec). + - The environment entity used to preserve serverless environment side panel, jobs' environment for non-notebook task, and SDP's environment for classic and serverless pipelines. In this minimal environment spec, only pip and java dependencies are supported. See [\_](#jobsnameenvironmentsspec). ::: @@ -3298,7 +3382,7 @@ For other serverless tasks, the task environment is required to be specified usi **`Type: Map`** -The environment entity used to preserve serverless environment side panel, jobs' environment for non-notebook task, and DLT's environment for classic and serverless pipelines. +The environment entity used to preserve serverless environment side panel, jobs' environment for non-notebook task, and SDP's environment for classic and serverless pipelines. In this minimal environment spec, only pip and java dependencies are supported. @@ -4013,10 +4097,6 @@ If not specified at cluster creation, a set of default values will be used. - Integer - Boot disk size in GB -- - `confidential_compute_type` - - String - - - - - `first_on_demand` - Integer - The first `first_on_demand` nodes of the cluster will be placed on on-demand instances. This value should be greater than 0, to make sure the cluster driver node is placed on an on-demand instance. If this value is greater than or equal to the current cluster size, all nodes will be placed on on-demand instances. If this value is less than the current cluster size, `first_on_demand` nodes will be placed on on-demand instances and the remainder will be placed on `availability` instances. Note that this value does not affect cluster size and cannot currently be mutated over the lifetime of a cluster. @@ -4600,6 +4680,10 @@ Read endpoints return only 100 tasks. If more than 100 tasks are available, you - Map - The task triggers a Power BI semantic model update when the `power_bi_task` field is present. See [\_](#jobsnametaskspower_bi_task). +- - `python_operator_task` + - Map + - See [\_](#jobsnametaskspython_operator_task). + - - `python_wheel_task` - Map - The task runs a Python wheel when the `python_wheel_task` field is present. See [\_](#jobsnametaskspython_wheel_task). @@ -5708,10 +5792,6 @@ If not specified at cluster creation, a set of default values will be used. - Integer - Boot disk size in GB -- - `confidential_compute_type` - - String - - - - - `first_on_demand` - Integer - The first `first_on_demand` nodes of the cluster will be placed on on-demand instances. This value should be greater than 0, to make sure the cluster driver node is placed on an on-demand instance. If this value is greater than or equal to the current cluster size, all nodes will be placed on on-demand instances. If this value is less than the current cluster size, `first_on_demand` nodes will be placed on on-demand instances and the remainder will be placed on `availability` instances. Note that this value does not affect cluster size and cannot currently be mutated over the lifetime of a cluster. @@ -6084,12 +6164,28 @@ The task triggers a pipeline update when the `pipeline_task` field is present. O - - `full_refresh` - Boolean - - If true, triggers a full refresh on the delta live table. + - If true, triggers a full refresh on the spark declarative pipeline. + +- - `full_refresh_selection` + - Sequence + - - - `pipeline_id` - String - The full name of the pipeline task to execute. +- - `refresh_flow_selection` + - Sequence + - + +- - `refresh_selection` + - Sequence + - + +- - `reset_checkpoint_selection` + - Sequence + - + ::: @@ -6278,7 +6374,23 @@ Controls whether the pipeline should perform a full refresh - - `full_refresh` - Boolean - - If true, triggers a full refresh on the delta live table. + - If true, triggers a full refresh on the spark declarative pipeline. + +- - `full_refresh_selection` + - Sequence + - + +- - `refresh_flow_selection` + - Sequence + - + +- - `refresh_selection` + - Sequence + - + +- - `reset_checkpoint_selection` + - Sequence + - ::: @@ -7345,7 +7457,7 @@ The core config of the serving endpoint. - - `auto_capture_config` - Map - - Configuration for Inference Tables which automatically logs requests and responses to Unity Catalog. Note: this field is deprecated for creating new provisioned throughput endpoints, or updating existing provisioned throughput endpoints that never have inference table configured; in these cases please use AI Gateway to manage inference tables. See [\_](#model_serving_endpointsnameconfigauto_capture_config). + - This field is deprecated - - `served_entities` - Sequence @@ -7362,42 +7474,6 @@ The core config of the serving endpoint. ::: -### model_serving_endpoints._name_.config.auto_capture_config - -**`Type: Map`** - -Configuration for Inference Tables which automatically logs requests and responses to Unity Catalog. -Note: this field is deprecated for creating new provisioned throughput endpoints, -or updating existing provisioned throughput endpoints that never have inference table configured; -in these cases please use AI Gateway to manage inference tables. - - - -:::list-table - -- - Key - - Type - - Description - -- - `catalog_name` - - String - - The name of the catalog in Unity Catalog. NOTE: On update, you cannot change the catalog name if the inference table is already enabled. - -- - `enabled` - - Boolean - - Indicates whether the inference table is enabled. - -- - `schema_name` - - String - - The name of the schema in Unity Catalog. NOTE: On update, you cannot change the schema name if the inference table is already enabled. - -- - `table_name_prefix` - - String - - The prefix of the table in Unity Catalog. NOTE: On update, you cannot change the prefix name if the inference table is already enabled. - -::: - - ### model_serving_endpoints._name_.config.served_entities **`Type: Sequence`** @@ -8278,7 +8354,7 @@ pipelines: - - `channel` - String - - DLT Release Channel that specifies which version to use. + - SDP Release Channel that specifies which version to use. - - `clusters` - Sequence @@ -8797,10 +8873,6 @@ If not specified at cluster creation, a set of default values will be used. - Integer - Boot disk size in GB -- - `confidential_compute_type` - - String - - - - - `first_on_demand` - Integer - The first `first_on_demand` nodes of the cluster will be placed on on-demand instances. This value should be greater than 0, to make sure the cluster driver node is placed on an on-demand instance. If this value is greater than or equal to the current cluster size, all nodes will be placed on on-demand instances. If this value is less than the current cluster size, `first_on_demand` nodes will be placed on on-demand instances and the remainder will be placed on `availability` instances. Note that this value does not affect cluster size and cannot currently be mutated over the lifetime of a cluster. @@ -9148,6 +9220,10 @@ The configuration for a managed ingestion pipeline. These settings cannot be use - Map - (Optional) A window that specifies a set of time ranges for snapshot queries in CDC. See [\_](#pipelinesnameingestion_definitionfull_refresh_window). +- - `ingest_from_uc_foreign_catalog` + - Boolean + - Immutable. If set to true, the pipeline will ingest tables from the UC foreign catalogs directly without the need to specify a UC connection or ingestion gateway. The `source_catalog` fields in objects of IngestionConfig are interpreted as the UC foreign catalogs to ingest from. + - - `ingestion_gateway_id` - String - Identifier for the gateway that is used by this ingestion pipeline to communicate with the source database. This is used with CDC connectors to databases like SQL Server using a gateway pipeline (connector_type = CDC). Under certain conditions, this can be replaced with connection_name to change the connector to Combined Cdc Managed Ingestion Pipeline. @@ -9300,6 +9376,18 @@ Configuration settings to control the ingestion of tables. These settings overri - Sequence - The primary key of the table used to apply changes. +- - `query_based_connector_config` + - Map + - Configurations that are only applicable for query-based ingestion connectors. See [\_](#pipelinesnameingestion_definitionobjectsreporttable_configurationquery_based_connector_config). + +- - `row_filter` + - String + - (Optional, Immutable) The row filter condition to be applied to the table. It must not contain the WHERE keyword, only the actual filter condition. It must be in DBSQL format. + +- - `scd_type` + - String + - The SCD type to use to ingest the table. + - - `sequence_by` - Sequence - The column names specifying the logical order of events in the source data. Spark Declarative Pipelines uses this sequencing to handle change events that arrive out of order. @@ -9342,6 +9430,35 @@ If unspecified, auto full refresh is disabled. ::: +### pipelines._name_.ingestion_definition.objects.report.table_configuration.query_based_connector_config + +**`Type: Map`** + +Configurations that are only applicable for query-based ingestion connectors. + + + +:::list-table + +- - Key + - Type + - Description + +- - `cursor_columns` + - Sequence + - The names of the monotonically increasing columns in the source table that are used to enable the table to be read and ingested incrementally through structured streaming. The columns are allowed to have repeated values but have to be non-decreasing. If the source data is merged into the destination (e.g., using SCD Type 1 or Type 2), these columns will implicitly define the `sequence_by` behavior. You can still explicitly set `sequence_by` to override this default. + +- - `deletion_condition` + - String + - Specifies a SQL WHERE condition that specifies that the source row has been deleted. This is sometimes referred to as "soft-deletes". For example: "Operation = 'DELETE'" or "is_deleted = true". This field is orthogonal to `hard_deletion_sync_interval_in_seconds`, one for soft-deletes and the other for hard-deletes. See also the hard_deletion_sync_min_interval_in_seconds field for handling of "hard deletes" where the source rows are physically removed from the table. + +- - `hard_deletion_sync_min_interval_in_seconds` + - Integer + - Specifies the minimum interval (in seconds) between snapshots on primary keys for detecting and synchronizing hard deletions—i.e., rows that have been physically removed from the source table. This interval acts as a lower bound. If ingestion runs less frequently than this value, hard deletion synchronization will align with the actual ingestion frequency instead of happening more often. If not set, hard deletion synchronization via snapshots is disabled. This field is mutable and can be updated without triggering a full snapshot. + +::: + + ### pipelines._name_.ingestion_definition.objects.schema **`Type: Map`** @@ -9356,6 +9473,10 @@ Select all tables from a specific source schema. - Type - Description +- - `connector_options` + - Map + - (Optional) Source Specific Connector Options. See [\_](#pipelinesnameingestion_definitionobjectsschemaconnector_options). + - - `destination_catalog` - String - Required. Destination catalog to store tables. @@ -9379,11 +9500,11 @@ Select all tables from a specific source schema. ::: -### pipelines._name_.ingestion_definition.objects.schema.table_configuration +### pipelines._name_.ingestion_definition.objects.schema.connector_options **`Type: Map`** -Configuration settings to control the ingestion of tables. These settings are applied to all tables in this schema and override the table_configuration defined in the IngestionPipelineDefinition object. +(Optional) Source Specific Connector Options @@ -9393,44 +9514,51 @@ Configuration settings to control the ingestion of tables. These settings are ap - Type - Description -- - `auto_full_refresh_policy` +- - `confluence_options` - Map - - (Optional, Mutable) Policy for auto full refresh, if enabled pipeline will automatically try to fix issues by doing a full refresh on the table in the retry run. auto_full_refresh_policy in table configuration will override the above level auto_full_refresh_policy. For example, { "auto_full_refresh_policy": { "enabled": true, "min_interval_hours": 23, } } If unspecified, auto full refresh is disabled. See [\_](#pipelinesnameingestion_definitionobjectsschematable_configurationauto_full_refresh_policy). + - Confluence specific options for ingestion. See [\_](#pipelinesnameingestion_definitionobjectsschemaconnector_optionsconfluence_options). -- - `exclude_columns` - - Sequence - - A list of column names to be excluded for the ingestion. When not specified, include_columns fully controls what columns to be ingested. When specified, all other columns including future ones will be automatically included for ingestion. This field in mutually exclusive with `include_columns`. +- - `jira_options` + - Map + - Jira specific options for ingestion. See [\_](#pipelinesnameingestion_definitionobjectsschemaconnector_optionsjira_options). -- - `include_columns` - - Sequence - - A list of column names to be included for the ingestion. When not specified, all columns except ones in exclude_columns will be included. Future columns will be automatically included. When specified, all other future columns will be automatically excluded from ingestion. This field in mutually exclusive with `exclude_columns`. +- - `kafka_options` + - Map + - See [\_](#pipelinesnameingestion_definitionobjectsschemaconnector_optionskafka_options). -- - `primary_keys` - - Sequence - - The primary key of the table used to apply changes. +- - `meta_ads_options` + - Map + - Meta Marketing (Meta Ads) specific options for ingestion. See [\_](#pipelinesnameingestion_definitionobjectsschemaconnector_optionsmeta_ads_options). -- - `sequence_by` +::: + + +### pipelines._name_.ingestion_definition.objects.schema.connector_options.confluence_options + +**`Type: Map`** + +Confluence specific options for ingestion + + + +:::list-table + +- - Key + - Type + - Description + +- - `include_confluence_spaces` - Sequence - - The column names specifying the logical order of events in the source data. Spark Declarative Pipelines uses this sequencing to handle change events that arrive out of order. + - (Optional) Spaces to filter Confluence data on ::: -### pipelines._name_.ingestion_definition.objects.schema.table_configuration.auto_full_refresh_policy +### pipelines._name_.ingestion_definition.objects.schema.connector_options.jira_options **`Type: Map`** -(Optional, Mutable) Policy for auto full refresh, if enabled pipeline will automatically try -to fix issues by doing a full refresh on the table in the retry run. auto_full_refresh_policy -in table configuration will override the above level auto_full_refresh_policy. -For example, -{ -"auto_full_refresh_policy": { -"enabled": true, -"min_interval_hours": 23, -} -} -If unspecified, auto full refresh is disabled. +Jira specific options for ingestion @@ -9440,22 +9568,18 @@ If unspecified, auto full refresh is disabled. - Type - Description -- - `enabled` - - Boolean - - (Required, Mutable) Whether to enable auto full refresh or not. - -- - `min_interval_hours` - - Integer - - (Optional, Mutable) Specify the minimum interval in hours between the timestamp at which a table was last full refreshed and the current timestamp for triggering auto full If unspecified and autoFullRefresh is enabled then by default min_interval_hours is 24 hours. +- - `include_jira_spaces` + - Sequence + - (Optional) Projects to filter Jira data on ::: -### pipelines._name_.ingestion_definition.objects.table +### pipelines._name_.ingestion_definition.objects.schema.connector_options.meta_ads_options **`Type: Map`** -Select a specific source table. +Meta Marketing (Meta Ads) specific options for ingestion @@ -9465,42 +9589,46 @@ Select a specific source table. - Type - Description -- - `destination_catalog` - - String - - Required. Destination catalog to store table. +- - `action_attribution_windows` + - Sequence + - (Optional) Action attribution windows for insights reporting (e.g. "28d_click", "1d_view") -- - `destination_schema` - - String - - Required. Destination schema to store table. +- - `action_breakdowns` + - Sequence + - (Optional) Action breakdowns to configure for data aggregation -- - `destination_table` +- - `action_report_time` - String - - Optional. Destination table name. The pipeline fails if a table with that name already exists. If not set, the source table name is used. + - (Optional) Timing used to report action statistics (impression, conversion, mixed, or lifetime) -- - `source_catalog` - - String - - Source catalog name. Might be optional depending on the type of source. +- - `breakdowns` + - Sequence + - (Optional) Breakdowns to configure for data aggregation -- - `source_schema` +- - `custom_insights_lookback_window` + - Integer + - (Optional) Window in days to revisit data during sync to capture updated conversion data from the API. + +- - `level` - String - - Schema name in the source database. Might be optional depending on the type of source. + - (Optional) Granularity of data to pull (account, ad, adset, campaign) -- - `source_table` +- - `start_date` - String - - Required. Table name in the source database. + - (Optional) Start date in yyyy-MM-dd format (e.g. 2025-01-15). Data added after this date will be ingested -- - `table_configuration` - - Map - - Configuration settings to control the ingestion of tables. These settings override the table_configuration defined in the IngestionPipelineDefinition object and the SchemaSpec. See [\_](#pipelinesnameingestion_definitionobjectstabletable_configuration). +- - `time_increment` + - String + - (Optional) Value in string by which to aggregate statistics (can take all_days, monthly or number of days) ::: -### pipelines._name_.ingestion_definition.objects.table.table_configuration +### pipelines._name_.ingestion_definition.objects.schema.table_configuration **`Type: Map`** -Configuration settings to control the ingestion of tables. These settings override the table_configuration defined in the IngestionPipelineDefinition object and the SchemaSpec. +Configuration settings to control the ingestion of tables. These settings are applied to all tables in this schema and override the table_configuration defined in the IngestionPipelineDefinition object. @@ -9512,7 +9640,293 @@ Configuration settings to control the ingestion of tables. These settings overri - - `auto_full_refresh_policy` - Map - - (Optional, Mutable) Policy for auto full refresh, if enabled pipeline will automatically try to fix issues by doing a full refresh on the table in the retry run. auto_full_refresh_policy in table configuration will override the above level auto_full_refresh_policy. For example, { "auto_full_refresh_policy": { "enabled": true, "min_interval_hours": 23, } } If unspecified, auto full refresh is disabled. See [\_](#pipelinesnameingestion_definitionobjectstabletable_configurationauto_full_refresh_policy). + - (Optional, Mutable) Policy for auto full refresh, if enabled pipeline will automatically try to fix issues by doing a full refresh on the table in the retry run. auto_full_refresh_policy in table configuration will override the above level auto_full_refresh_policy. For example, { "auto_full_refresh_policy": { "enabled": true, "min_interval_hours": 23, } } If unspecified, auto full refresh is disabled. See [\_](#pipelinesnameingestion_definitionobjectsschematable_configurationauto_full_refresh_policy). + +- - `exclude_columns` + - Sequence + - A list of column names to be excluded for the ingestion. When not specified, include_columns fully controls what columns to be ingested. When specified, all other columns including future ones will be automatically included for ingestion. This field in mutually exclusive with `include_columns`. + +- - `include_columns` + - Sequence + - A list of column names to be included for the ingestion. When not specified, all columns except ones in exclude_columns will be included. Future columns will be automatically included. When specified, all other future columns will be automatically excluded from ingestion. This field in mutually exclusive with `exclude_columns`. + +- - `primary_keys` + - Sequence + - The primary key of the table used to apply changes. + +- - `query_based_connector_config` + - Map + - Configurations that are only applicable for query-based ingestion connectors. See [\_](#pipelinesnameingestion_definitionobjectsschematable_configurationquery_based_connector_config). + +- - `row_filter` + - String + - (Optional, Immutable) The row filter condition to be applied to the table. It must not contain the WHERE keyword, only the actual filter condition. It must be in DBSQL format. + +- - `scd_type` + - String + - The SCD type to use to ingest the table. + +- - `sequence_by` + - Sequence + - The column names specifying the logical order of events in the source data. Spark Declarative Pipelines uses this sequencing to handle change events that arrive out of order. + +::: + + +### pipelines._name_.ingestion_definition.objects.schema.table_configuration.auto_full_refresh_policy + +**`Type: Map`** + +(Optional, Mutable) Policy for auto full refresh, if enabled pipeline will automatically try +to fix issues by doing a full refresh on the table in the retry run. auto_full_refresh_policy +in table configuration will override the above level auto_full_refresh_policy. +For example, +{ +"auto_full_refresh_policy": { +"enabled": true, +"min_interval_hours": 23, +} +} +If unspecified, auto full refresh is disabled. + + + +:::list-table + +- - Key + - Type + - Description + +- - `enabled` + - Boolean + - (Required, Mutable) Whether to enable auto full refresh or not. + +- - `min_interval_hours` + - Integer + - (Optional, Mutable) Specify the minimum interval in hours between the timestamp at which a table was last full refreshed and the current timestamp for triggering auto full If unspecified and autoFullRefresh is enabled then by default min_interval_hours is 24 hours. + +::: + + +### pipelines._name_.ingestion_definition.objects.schema.table_configuration.query_based_connector_config + +**`Type: Map`** + +Configurations that are only applicable for query-based ingestion connectors. + + + +:::list-table + +- - Key + - Type + - Description + +- - `cursor_columns` + - Sequence + - The names of the monotonically increasing columns in the source table that are used to enable the table to be read and ingested incrementally through structured streaming. The columns are allowed to have repeated values but have to be non-decreasing. If the source data is merged into the destination (e.g., using SCD Type 1 or Type 2), these columns will implicitly define the `sequence_by` behavior. You can still explicitly set `sequence_by` to override this default. + +- - `deletion_condition` + - String + - Specifies a SQL WHERE condition that specifies that the source row has been deleted. This is sometimes referred to as "soft-deletes". For example: "Operation = 'DELETE'" or "is_deleted = true". This field is orthogonal to `hard_deletion_sync_interval_in_seconds`, one for soft-deletes and the other for hard-deletes. See also the hard_deletion_sync_min_interval_in_seconds field for handling of "hard deletes" where the source rows are physically removed from the table. + +- - `hard_deletion_sync_min_interval_in_seconds` + - Integer + - Specifies the minimum interval (in seconds) between snapshots on primary keys for detecting and synchronizing hard deletions—i.e., rows that have been physically removed from the source table. This interval acts as a lower bound. If ingestion runs less frequently than this value, hard deletion synchronization will align with the actual ingestion frequency instead of happening more often. If not set, hard deletion synchronization via snapshots is disabled. This field is mutable and can be updated without triggering a full snapshot. + +::: + + +### pipelines._name_.ingestion_definition.objects.table + +**`Type: Map`** + +Select a specific source table. + + + +:::list-table + +- - Key + - Type + - Description + +- - `connector_options` + - Map + - (Optional) Source Specific Connector Options. See [\_](#pipelinesnameingestion_definitionobjectstableconnector_options). + +- - `destination_catalog` + - String + - Required. Destination catalog to store table. + +- - `destination_schema` + - String + - Required. Destination schema to store table. + +- - `destination_table` + - String + - Optional. Destination table name. The pipeline fails if a table with that name already exists. If not set, the source table name is used. + +- - `source_catalog` + - String + - Source catalog name. Might be optional depending on the type of source. + +- - `source_schema` + - String + - Schema name in the source database. Might be optional depending on the type of source. + +- - `source_table` + - String + - Required. Table name in the source database. + +- - `table_configuration` + - Map + - Configuration settings to control the ingestion of tables. These settings override the table_configuration defined in the IngestionPipelineDefinition object and the SchemaSpec. See [\_](#pipelinesnameingestion_definitionobjectstabletable_configuration). + +::: + + +### pipelines._name_.ingestion_definition.objects.table.connector_options + +**`Type: Map`** + +(Optional) Source Specific Connector Options + + + +:::list-table + +- - Key + - Type + - Description + +- - `confluence_options` + - Map + - Confluence specific options for ingestion. See [\_](#pipelinesnameingestion_definitionobjectstableconnector_optionsconfluence_options). + +- - `jira_options` + - Map + - Jira specific options for ingestion. See [\_](#pipelinesnameingestion_definitionobjectstableconnector_optionsjira_options). + +- - `kafka_options` + - Map + - See [\_](#pipelinesnameingestion_definitionobjectstableconnector_optionskafka_options). + +- - `meta_ads_options` + - Map + - Meta Marketing (Meta Ads) specific options for ingestion. See [\_](#pipelinesnameingestion_definitionobjectstableconnector_optionsmeta_ads_options). + +::: + + +### pipelines._name_.ingestion_definition.objects.table.connector_options.confluence_options + +**`Type: Map`** + +Confluence specific options for ingestion + + + +:::list-table + +- - Key + - Type + - Description + +- - `include_confluence_spaces` + - Sequence + - (Optional) Spaces to filter Confluence data on + +::: + + +### pipelines._name_.ingestion_definition.objects.table.connector_options.jira_options + +**`Type: Map`** + +Jira specific options for ingestion + + + +:::list-table + +- - Key + - Type + - Description + +- - `include_jira_spaces` + - Sequence + - (Optional) Projects to filter Jira data on + +::: + + +### pipelines._name_.ingestion_definition.objects.table.connector_options.meta_ads_options + +**`Type: Map`** + +Meta Marketing (Meta Ads) specific options for ingestion + + + +:::list-table + +- - Key + - Type + - Description + +- - `action_attribution_windows` + - Sequence + - (Optional) Action attribution windows for insights reporting (e.g. "28d_click", "1d_view") + +- - `action_breakdowns` + - Sequence + - (Optional) Action breakdowns to configure for data aggregation + +- - `action_report_time` + - String + - (Optional) Timing used to report action statistics (impression, conversion, mixed, or lifetime) + +- - `breakdowns` + - Sequence + - (Optional) Breakdowns to configure for data aggregation + +- - `custom_insights_lookback_window` + - Integer + - (Optional) Window in days to revisit data during sync to capture updated conversion data from the API. + +- - `level` + - String + - (Optional) Granularity of data to pull (account, ad, adset, campaign) + +- - `start_date` + - String + - (Optional) Start date in yyyy-MM-dd format (e.g. 2025-01-15). Data added after this date will be ingested + +- - `time_increment` + - String + - (Optional) Value in string by which to aggregate statistics (can take all_days, monthly or number of days) + +::: + + +### pipelines._name_.ingestion_definition.objects.table.table_configuration + +**`Type: Map`** + +Configuration settings to control the ingestion of tables. These settings override the table_configuration defined in the IngestionPipelineDefinition object and the SchemaSpec. + + + +:::list-table + +- - Key + - Type + - Description + +- - `auto_full_refresh_policy` + - Map + - (Optional, Mutable) Policy for auto full refresh, if enabled pipeline will automatically try to fix issues by doing a full refresh on the table in the retry run. auto_full_refresh_policy in table configuration will override the above level auto_full_refresh_policy. For example, { "auto_full_refresh_policy": { "enabled": true, "min_interval_hours": 23, } } If unspecified, auto full refresh is disabled. See [\_](#pipelinesnameingestion_definitionobjectstabletable_configurationauto_full_refresh_policy). - - `exclude_columns` - Sequence @@ -9526,6 +9940,18 @@ Configuration settings to control the ingestion of tables. These settings overri - Sequence - The primary key of the table used to apply changes. +- - `query_based_connector_config` + - Map + - Configurations that are only applicable for query-based ingestion connectors. See [\_](#pipelinesnameingestion_definitionobjectstabletable_configurationquery_based_connector_config). + +- - `row_filter` + - String + - (Optional, Immutable) The row filter condition to be applied to the table. It must not contain the WHERE keyword, only the actual filter condition. It must be in DBSQL format. + +- - `scd_type` + - String + - The SCD type to use to ingest the table. + - - `sequence_by` - Sequence - The column names specifying the logical order of events in the source data. Spark Declarative Pipelines uses this sequencing to handle change events that arrive out of order. @@ -9568,6 +9994,35 @@ If unspecified, auto full refresh is disabled. ::: +### pipelines._name_.ingestion_definition.objects.table.table_configuration.query_based_connector_config + +**`Type: Map`** + +Configurations that are only applicable for query-based ingestion connectors. + + + +:::list-table + +- - Key + - Type + - Description + +- - `cursor_columns` + - Sequence + - The names of the monotonically increasing columns in the source table that are used to enable the table to be read and ingested incrementally through structured streaming. The columns are allowed to have repeated values but have to be non-decreasing. If the source data is merged into the destination (e.g., using SCD Type 1 or Type 2), these columns will implicitly define the `sequence_by` behavior. You can still explicitly set `sequence_by` to override this default. + +- - `deletion_condition` + - String + - Specifies a SQL WHERE condition that specifies that the source row has been deleted. This is sometimes referred to as "soft-deletes". For example: "Operation = 'DELETE'" or "is_deleted = true". This field is orthogonal to `hard_deletion_sync_interval_in_seconds`, one for soft-deletes and the other for hard-deletes. See also the hard_deletion_sync_min_interval_in_seconds field for handling of "hard deletes" where the source rows are physically removed from the table. + +- - `hard_deletion_sync_min_interval_in_seconds` + - Integer + - Specifies the minimum interval (in seconds) between snapshots on primary keys for detecting and synchronizing hard deletions—i.e., rows that have been physically removed from the source table. This interval acts as a lower bound. If ingestion runs less frequently than this value, hard deletion synchronization will align with the actual ingestion frequency instead of happening more often. If not set, hard deletion synchronization via snapshots is disabled. This field is mutable and can be updated without triggering a full snapshot. + +::: + + ### pipelines._name_.ingestion_definition.source_configurations **`Type: Sequence`** @@ -9586,10 +10041,6 @@ Top-level source configurations - Map - Catalog-level source configuration parameters. See [\_](#pipelinesnameingestion_definitionsource_configurationscatalog). -- - `google_ads_config` - - Map - - See [\_](#pipelinesnameingestion_definitionsource_configurationsgoogle_ads_config). - ::: @@ -9694,6 +10145,18 @@ Configuration settings to control the ingestion of tables. These settings are ap - Sequence - The primary key of the table used to apply changes. +- - `query_based_connector_config` + - Map + - Configurations that are only applicable for query-based ingestion connectors. See [\_](#pipelinesnameingestion_definitiontable_configurationquery_based_connector_config). + +- - `row_filter` + - String + - (Optional, Immutable) The row filter condition to be applied to the table. It must not contain the WHERE keyword, only the actual filter condition. It must be in DBSQL format. + +- - `scd_type` + - String + - The SCD type to use to ingest the table. + - - `sequence_by` - Sequence - The column names specifying the logical order of events in the source data. Spark Declarative Pipelines uses this sequencing to handle change events that arrive out of order. @@ -9736,6 +10199,35 @@ If unspecified, auto full refresh is disabled. ::: +### pipelines._name_.ingestion_definition.table_configuration.query_based_connector_config + +**`Type: Map`** + +Configurations that are only applicable for query-based ingestion connectors. + + + +:::list-table + +- - Key + - Type + - Description + +- - `cursor_columns` + - Sequence + - The names of the monotonically increasing columns in the source table that are used to enable the table to be read and ingested incrementally through structured streaming. The columns are allowed to have repeated values but have to be non-decreasing. If the source data is merged into the destination (e.g., using SCD Type 1 or Type 2), these columns will implicitly define the `sequence_by` behavior. You can still explicitly set `sequence_by` to override this default. + +- - `deletion_condition` + - String + - Specifies a SQL WHERE condition that specifies that the source row has been deleted. This is sometimes referred to as "soft-deletes". For example: "Operation = 'DELETE'" or "is_deleted = true". This field is orthogonal to `hard_deletion_sync_interval_in_seconds`, one for soft-deletes and the other for hard-deletes. See also the hard_deletion_sync_min_interval_in_seconds field for handling of "hard deletes" where the source rows are physically removed from the table. + +- - `hard_deletion_sync_min_interval_in_seconds` + - Integer + - Specifies the minimum interval (in seconds) between snapshots on primary keys for detecting and synchronizing hard deletions—i.e., rows that have been physically removed from the source table. This interval acts as a lower bound. If ingestion runs less frequently than this value, hard deletion synchronization will align with the actual ingestion frequency instead of happening more often. If not set, hard deletion synchronization via snapshots is disabled. This field is mutable and can be updated without triggering a full snapshot. + +::: + + ### pipelines._name_.libraries **`Type: Sequence`** @@ -9983,6 +10475,10 @@ postgres_branches: - String - +- - `replace_existing` + - Boolean + - + - - `source_branch` - String - @@ -10010,6 +10506,69 @@ postgres_branches: +:::list-table + +- - Key + - Type + - Description + +- - `prevent_destroy` + - Boolean + - Lifecycle setting to prevent the resource from being destroyed. + +::: + + +## postgres_catalogs + +**`Type: Map`** + +The Postgres catalog definitions for the bundle, where each key is the name of the catalog. Each entry binds a Unity Catalog catalog to a Postgres database on a Lakebase Autoscaling branch. + +```yaml +postgres_catalogs: + : + : +``` + + +:::list-table + +- - Key + - Type + - Description + +- - `branch` + - String + - + +- - `catalog_id` + - String + - + +- - `create_database_if_missing` + - Boolean + - + +- - `lifecycle` + - Map + - See [\_](#postgres_catalogsnamelifecycle). + +- - `postgres_database` + - String + - + +::: + + +### postgres_catalogs._name_.lifecycle + +**`Type: Map`** + + + + + :::list-table - - Key @@ -10078,6 +10637,10 @@ postgres_endpoints: - String - +- - `replace_existing` + - Boolean + - + - - `settings` - Map - A collection of settings for a compute endpoint. See [\_](#postgres_endpointsnamesettings). @@ -10275,7 +10838,7 @@ A collection of settings for a compute endpoint. - - `no_suspension` - Boolean - - When set to true, explicitly disables automatic suspension (never suspend). Should be set to true when provided. + - When set to true, explicitly disables automatic suspension (never suspend). Should be set to true when provided. Mutually exclusive with `suspend_timeout_duration`. When updating, use `spec.project_default_settings.suspension` in the update_mask. - - `pg_settings` - Map @@ -10283,7 +10846,7 @@ A collection of settings for a compute endpoint. - - `suspend_timeout_duration` - String - - Duration of inactivity after which the compute endpoint is automatically suspended. If specified should be between 60s and 604800s (1 minute to 1 week). + - Duration of inactivity after which the compute endpoint is automatically suspended. If specified should be between 60s and 604800s (1 minute to 1 week). Mutually exclusive with `no_suspension`. When updating, use `spec.project_default_settings.suspension` in the update_mask. ::: @@ -10342,6 +10905,93 @@ A collection of settings for a compute endpoint. ::: +## postgres_synced_tables + +**`Type: Map`** + +The Postgres synced table definitions for the bundle, where each key is the name of the synced table. Each entry continuously replicates a Unity Catalog Delta source table into a Postgres table on a Lakebase Autoscaling instance. + +```yaml +postgres_synced_tables: + : + : +``` + + +:::list-table + +- - Key + - Type + - Description + +- - `branch` + - String + - + +- - `create_database_objects_if_missing` + - Boolean + - + +- - `existing_pipeline_id` + - String + - + +- - `lifecycle` + - Map + - See [\_](#postgres_synced_tablesnamelifecycle). + +- - `new_pipeline_spec` + - Map + - See [\_](#postgres_synced_tablesnamenew_pipeline_spec). + +- - `postgres_database` + - String + - + +- - `primary_key_columns` + - Sequence + - + +- - `scheduling_policy` + - String + - + +- - `source_table_full_name` + - String + - + +- - `synced_table_id` + - String + - + +- - `timeseries_key` + - String + - + +::: + + +### postgres_synced_tables._name_.lifecycle + +**`Type: Map`** + + + + + +:::list-table + +- - Key + - Type + - Description + +- - `prevent_destroy` + - Boolean + - Lifecycle setting to prevent the resource from being destroyed. + +::: + + ## quality_monitors **`Type: Map`** diff --git a/bundle/internal/schema/annotations_openapi.yml b/bundle/internal/schema/annotations_openapi.yml index 23c5770dcc0..912d9158e40 100644 --- a/bundle/internal/schema/annotations_openapi.yml +++ b/bundle/internal/schema/annotations_openapi.yml @@ -115,6 +115,11 @@ github.com/databricks/cli/bundle/config/resources.App: "description": |- Git repository configuration for app deployments. When specified, deployments can reference code from this repository by providing only the git reference (branch, tag, or commit). + "git_source": + "description": |- + Complete git source specification including repository location and reference. + "x-databricks-preview": |- + PRIVATE "id": "description": |- The unique identifier of the app. @@ -148,6 +153,9 @@ github.com/databricks/cli/bundle/config/resources.App: "service_principal_name": "x-databricks-field-behaviors_output_only": |- true + "source_code_path": + "x-databricks-preview": |- + PRIVATE "space": "description": |- Name of the space this app belongs to. @@ -256,15 +264,14 @@ github.com/databricks/cli/bundle/config/resources.Cluster: Data security mode decides what data governance model to use when accessing data from a cluster. - The following modes can only be used when `kind = CLASSIC_PREVIEW`. * `DATA_SECURITY_MODE_AUTO`: Databricks will choose the most appropriate access mode depending on your compute configuration. - * `DATA_SECURITY_MODE_STANDARD`: Alias for `USER_ISOLATION`. - * `DATA_SECURITY_MODE_DEDICATED`: Alias for `SINGLE_USER`. + * `DATA_SECURITY_MODE_STANDARD`: A secure cluster that can be shared by multiple users. Cluster users are fully isolated so that they cannot see each other’s data and credentials. Most data governance features are supported in this mode. But programming languages and cluster features might be limited. + * `DATA_SECURITY_MODE_DEDICATED`: A secure cluster that can only be exclusively used by a single user specified in `single_user_name`. Most programming languages, cluster features and data governance features are available in this mode. + + The following modes are legacy aliases for the above modes: - The following modes can be used regardless of `kind`. - * `NONE`: No security isolation for multiple users sharing the cluster. Data governance features are not available in this mode. - * `SINGLE_USER`: A secure cluster that can only be exclusively used by a single user specified in `single_user_name`. Most programming languages, cluster features and data governance features are available in this mode. - * `USER_ISOLATION`: A secure cluster that can be shared by multiple users. Cluster users are fully isolated so that they cannot see each other's data and credentials. Most data governance features are supported in this mode. But programming languages and cluster features might be limited. + * `USER_ISOLATION`: Legacy alias for `DATA_SECURITY_MODE_STANDARD`. + * `SINGLE_USER`: Legacy alias for `DATA_SECURITY_MODE_DEDICATED`. The following modes are deprecated starting with Databricks Runtime 15.0 and will be removed for future Databricks Runtime versions: @@ -325,7 +332,6 @@ github.com/databricks/cli/bundle/config/resources.Cluster: Clusters with `kind = CLASSIC_PREVIEW` support the following fields, whereas clusters with no specified `kind` do not. * [is_single_node](/api/workspace/clusters/create#is_single_node) * [use_ml_runtime](/api/workspace/clusters/create#use_ml_runtime) - * [data_security_mode](/api/workspace/clusters/create#data_security_mode) set to `DATA_SECURITY_MODE_AUTO`, `DATA_SECURITY_MODE_DEDICATED`, or `DATA_SECURITY_MODE_STANDARD` By using the [simple form](https://docs.databricks.com/compute/simple-form.html), your clusters are automatically using `kind = CLASSIC_PREVIEW`. "node_type_id": @@ -1139,7 +1145,7 @@ github.com/databricks/cli/bundle/config/resources.VectorSearchEndpoint: Type of endpoint "name": "description": |- - Name of the vector search endpoint + Name of the AI Search endpoint "target_qps": "description": |- Target QPS for the endpoint. Mutually exclusive with num_replicas. @@ -1905,6 +1911,10 @@ github.com/databricks/databricks-sdk-go/service/catalog.Privilege: MANAGE_ACCESS_CONTROL - |- CREATE_SERVICE + - |- + CREATE_FEATURE + - |- + READ_FEATURE github.com/databricks/databricks-sdk-go/service/catalog.PrivilegeAssignment: "principal": "description": |- @@ -2192,15 +2202,14 @@ github.com/databricks/databricks-sdk-go/service/compute.ClusterSpec: Data security mode decides what data governance model to use when accessing data from a cluster. - The following modes can only be used when `kind = CLASSIC_PREVIEW`. * `DATA_SECURITY_MODE_AUTO`: Databricks will choose the most appropriate access mode depending on your compute configuration. - * `DATA_SECURITY_MODE_STANDARD`: Alias for `USER_ISOLATION`. - * `DATA_SECURITY_MODE_DEDICATED`: Alias for `SINGLE_USER`. + * `DATA_SECURITY_MODE_STANDARD`: A secure cluster that can be shared by multiple users. Cluster users are fully isolated so that they cannot see each other’s data and credentials. Most data governance features are supported in this mode. But programming languages and cluster features might be limited. + * `DATA_SECURITY_MODE_DEDICATED`: A secure cluster that can only be exclusively used by a single user specified in `single_user_name`. Most programming languages, cluster features and data governance features are available in this mode. + + The following modes are legacy aliases for the above modes: - The following modes can be used regardless of `kind`. - * `NONE`: No security isolation for multiple users sharing the cluster. Data governance features are not available in this mode. - * `SINGLE_USER`: A secure cluster that can only be exclusively used by a single user specified in `single_user_name`. Most programming languages, cluster features and data governance features are available in this mode. - * `USER_ISOLATION`: A secure cluster that can be shared by multiple users. Cluster users are fully isolated so that they cannot see each other's data and credentials. Most data governance features are supported in this mode. But programming languages and cluster features might be limited. + * `USER_ISOLATION`: Legacy alias for `DATA_SECURITY_MODE_STANDARD`. + * `SINGLE_USER`: Legacy alias for `DATA_SECURITY_MODE_DEDICATED`. The following modes are deprecated starting with Databricks Runtime 15.0 and will be removed for future Databricks Runtime versions: @@ -2261,7 +2270,6 @@ github.com/databricks/databricks-sdk-go/service/compute.ClusterSpec: Clusters with `kind = CLASSIC_PREVIEW` support the following fields, whereas clusters with no specified `kind` do not. * [is_single_node](/api/workspace/clusters/create#is_single_node) * [use_ml_runtime](/api/workspace/clusters/create#use_ml_runtime) - * [data_security_mode](/api/workspace/clusters/create#data_security_mode) set to `DATA_SECURITY_MODE_AUTO`, `DATA_SECURITY_MODE_DEDICATED`, or `DATA_SECURITY_MODE_STANDARD` By using the [simple form](https://docs.databricks.com/compute/simple-form.html), your clusters are automatically using `kind = CLASSIC_PREVIEW`. "node_type_id": @@ -2358,15 +2366,14 @@ github.com/databricks/databricks-sdk-go/service/compute.DataSecurityMode: Data security mode decides what data governance model to use when accessing data from a cluster. - The following modes can only be used when `kind = CLASSIC_PREVIEW`. * `DATA_SECURITY_MODE_AUTO`: Databricks will choose the most appropriate access mode depending on your compute configuration. - * `DATA_SECURITY_MODE_STANDARD`: Alias for `USER_ISOLATION`. - * `DATA_SECURITY_MODE_DEDICATED`: Alias for `SINGLE_USER`. + * `DATA_SECURITY_MODE_STANDARD`: A secure cluster that can be shared by multiple users. Cluster users are fully isolated so that they cannot see each other’s data and credentials. Most data governance features are supported in this mode. But programming languages and cluster features might be limited. + * `DATA_SECURITY_MODE_DEDICATED`: A secure cluster that can only be exclusively used by a single user specified in `single_user_name`. Most programming languages, cluster features and data governance features are available in this mode. - The following modes can be used regardless of `kind`. - * `NONE`: No security isolation for multiple users sharing the cluster. Data governance features are not available in this mode. - * `SINGLE_USER`: A secure cluster that can only be exclusively used by a single user specified in `single_user_name`. Most programming languages, cluster features and data governance features are available in this mode. - * `USER_ISOLATION`: A secure cluster that can be shared by multiple users. Cluster users are fully isolated so that they cannot see each other's data and credentials. Most data governance features are supported in this mode. But programming languages and cluster features might be limited. + The following modes are legacy aliases for the above modes: + + * `USER_ISOLATION`: Legacy alias for `DATA_SECURITY_MODE_STANDARD`. + * `SINGLE_USER`: Legacy alias for `DATA_SECURITY_MODE_DEDICATED`. The following modes are deprecated starting with Databricks Runtime 15.0 and will be removed for future Databricks Runtime versions: @@ -2439,7 +2446,10 @@ github.com/databricks/databricks-sdk-go/service/compute.Environment: (e.g., `/Workspace/path/to/env.yaml`). Support for a Databricks-provided base environment ID (e.g., `workspace-base-environments/databricks_ai_v4`) and workspace base environment ID (e.g., `workspace-base-environments/dbe_b849b66e-b31a-4cb5-b161-1f2b10877fb7`) is in Beta. - Either `environment_version` or `base_environment` can be provided. For more information, see + Either `environment_version` or `base_environment` can be provided. + For more information about Databricks-provided base environments, see the + [list workspace base environments](:method:Environments/ListWorkspaceBaseEnvironments) API. + For more information, see "client": "description": |- Use `environment_version` instead. @@ -2801,7 +2811,7 @@ github.com/databricks/databricks-sdk-go/service/database.DatabaseInstanceState: - |- FAILING_OVER - |- - MIGRATING + UPGRADING github.com/databricks/databricks-sdk-go/service/database.DeltaTableSyncInfo: "delta_commit_timestamp": "description": |- @@ -3755,13 +3765,39 @@ github.com/databricks/databricks-sdk-go/service/jobs.PipelineParams: "full_refresh": "description": |- If true, triggers a full refresh on the spark declarative pipeline. + "full_refresh_selection": + "description": |- + A list of tables to update with fullRefresh. + "refresh_flow_selection": + "description": |- + Flow names to selectively refresh. These are unioned with other selective refresh + options (refresh_selection, full_refresh_selection) to determine the final set of flows to refresh. + "refresh_selection": + "description": |- + A list of tables to update without fullRefresh. + "reset_checkpoint_selection": + "description": |- + A list of streaming flows to reset checkpoints without clearing data. github.com/databricks/databricks-sdk-go/service/jobs.PipelineTask: "full_refresh": "description": |- If true, triggers a full refresh on the spark declarative pipeline. + "full_refresh_selection": + "description": |- + A list of tables to update with fullRefresh. "pipeline_id": "description": |- The full name of the pipeline task to execute. + "refresh_flow_selection": + "description": |- + Flow names to selectively refresh. These are unioned with other selective refresh + options (refresh_selection, full_refresh_selection) to determine the final set of flows to refresh. + "refresh_selection": + "description": |- + A list of tables to update without fullRefresh. + "reset_checkpoint_selection": + "description": |- + A list of streaming flows to reset checkpoints without clearing data. github.com/databricks/databricks-sdk-go/service/jobs.PowerBiModel: "authentication_method": "description": |- @@ -3807,6 +3843,18 @@ github.com/databricks/databricks-sdk-go/service/jobs.PowerBiTask: "warehouse_id": "description": |- The SQL warehouse ID to use as the Power BI data source +github.com/databricks/databricks-sdk-go/service/jobs.PythonOperatorTask: + "main": + "description": |- + Fully qualified name of the main class or function. + For example, `my_project.my_function` or `my_project.MyOperator`. + "parameters": + "description": |- + An ordered list of task parameters. + TODO(JOBS-30885): Add limits for parameters. +github.com/databricks/databricks-sdk-go/service/jobs.PythonOperatorTaskParameter: + "name": {} + "value": {} github.com/databricks/databricks-sdk-go/service/jobs.PythonWheelTask: "entry_point": "description": |- @@ -4162,8 +4210,6 @@ github.com/databricks/databricks-sdk-go/service/jobs.Task: "disabled": "description": |- An optional flag to disable the task. If set to true, the task will not run even if it is part of a job. - "x-databricks-preview": |- - PRIVATE "email_notifications": "description": |- An optional set of email addresses that is notified when runs of this task begin or complete as well as when this task is deleted. The default behavior is to not send any emails. @@ -4213,6 +4259,11 @@ github.com/databricks/databricks-sdk-go/service/jobs.Task: "power_bi_task": "description": |- The task triggers a Power BI semantic model update when the `power_bi_task` field is present. + "python_operator_task": + "description": |- + The task runs a Python operator task. + "x-databricks-preview": |- + PRIVATE "python_wheel_task": "description": |- The task runs a Python wheel when the `python_wheel_task` field is present. @@ -4440,6 +4491,9 @@ github.com/databricks/databricks-sdk-go/service/pipelines.ConnectorOptions: "jira_options": "description": |- Jira specific options for ingestion + "kafka_options": + "x-databricks-preview": |- + PRIVATE "meta_ads_options": "description": |- Meta Marketing (Meta Ads) specific options for ingestion @@ -4599,6 +4653,8 @@ github.com/databricks/databricks-sdk-go/service/pipelines.FileIngestionOptionsFi AVRO - |- ORC + - |- + FILE github.com/databricks/databricks-sdk-go/service/pipelines.FileIngestionOptionsSchemaEvolutionMode: "_": "description": |- @@ -4668,6 +4724,10 @@ github.com/databricks/databricks-sdk-go/service/pipelines.GoogleDriveOptionsGoog FILE_METADATA - |- PERMISSION + - |- + FILE_PERMISSION + - |- + GROUP_MEMBERSHIP github.com/databricks/databricks-sdk-go/service/pipelines.IngestionConfig: "report": "description": |- @@ -5042,6 +5102,55 @@ github.com/databricks/databricks-sdk-go/service/pipelines.JiraConnectorOptions: "include_jira_spaces": "description": |- (Optional) Projects to filter Jira data on +github.com/databricks/databricks-sdk-go/service/pipelines.JsonTransformerOptions: + "as_variant": + "description": |- + Parse the entire value as a single Variant column. + "schema": + "description": |- + Inline schema string for JSON parsing (Spark DDL format). + "schema_evolution_mode": + "description": |- + (Optional) Schema evolution mode for schema inference. + "schema_file_path": + "description": |- + Path to a schema file (.ddl). + "schema_hints": + "description": |- + (Optional) Schema hints as a comma-separated string of "column_name type" pairs. +github.com/databricks/databricks-sdk-go/service/pipelines.KafkaOptions: + "client_config": + "description": |- + Undocumented backdoor mechanism for overriding parameters + to pass to the Kafka client. + This is not supported and may break at any time. + "x-databricks-preview": |- + PRIVATE + "key_transformer": + "description": |- + (Optional) Transformer for the message key. + If not specified, the key is left as raw bytes. + "max_offsets_per_trigger": + "description": |- + Internal option to control the maximum number of offsets to process per trigger. + "x-databricks-preview": |- + PRIVATE + "starting_offset": + "description": |- + (Optional) Where to begin reading when no checkpoint exists. + Valid values: "latest" and "earliest". Defaults to "latest". + "topic_pattern": + "description": |- + Java regex pattern to subscribe to matching topics. + Only one of topics or topic_pattern must be specified. + "topics": + "description": |- + Topics to subscribe to. + Only one of topics or topic_pattern must be specified. + "value_transformer": + "description": |- + (Optional) Transformer for the message value. + If not specified, the value is left as raw bytes. github.com/databricks/databricks-sdk-go/service/pipelines.ManualTrigger: {} github.com/databricks/databricks-sdk-go/service/pipelines.MetaMarketingOptions: "_": @@ -5488,6 +5597,10 @@ github.com/databricks/databricks-sdk-go/service/pipelines.SharepointOptionsShare PERMISSION - |- LIST + - |- + FILE_PERMISSION + - |- + GROUP_MEMBERSHIP github.com/databricks/databricks-sdk-go/service/pipelines.SmartsheetOptions: "_": "description": |- @@ -5674,6 +5787,25 @@ github.com/databricks/databricks-sdk-go/service/pipelines.TikTokAdsOptionsTikTok BUSINESS_CENTER - |- GMV_MAX +github.com/databricks/databricks-sdk-go/service/pipelines.Transformer: + "_": + "description": |- + Specifies how to transform binary data into structured data. + "format": + "description": |- + Required: the wire format of the data. + "json_options": {} +github.com/databricks/databricks-sdk-go/service/pipelines.TransformerFormat: + "_": + "enum": + - |- + STRING + - |- + JSON + - |- + AVRO + - |- + PROTOBUF github.com/databricks/databricks-sdk-go/service/pipelines.ZendeskSupportOptions: "_": "description": |- @@ -5712,6 +5844,18 @@ github.com/databricks/databricks-sdk-go/service/postgres.EndpointType: ENDPOINT_TYPE_READ_WRITE - |- ENDPOINT_TYPE_READ_ONLY +github.com/databricks/databricks-sdk-go/service/postgres.NewPipelineSpec: + "budget_policy_id": + "description": |- + Budget policy to set on the newly created pipeline. + "storage_catalog": + "description": |- + UC catalog for the pipeline to store intermediate files (checkpoints, event logs etc). + This needs to be a standard catalog where the user has permissions to create Delta tables. + "storage_schema": + "description": |- + UC schema for the pipeline to store intermediate files (checkpoints, event logs etc). + This needs to be in the standard catalog where the user has permissions to create Delta tables. github.com/databricks/databricks-sdk-go/service/postgres.ProjectCustomTag: "key": "description": |- @@ -5742,6 +5886,17 @@ github.com/databricks/databricks-sdk-go/service/postgres.ProjectDefaultEndpointS Duration of inactivity after which the compute endpoint is automatically suspended. If specified should be between 60s and 604800s (1 minute to 1 week). Mutually exclusive with `no_suspension`. When updating, use `spec.project_default_settings.suspension` in the update_mask. +github.com/databricks/databricks-sdk-go/service/postgres.SyncedTableSyncedTableSpecSyncedTableSchedulingPolicy: + "_": + "description": |- + Scheduling policy of the synced table's underlying pipeline. + "enum": + - |- + CONTINUOUS + - |- + TRIGGERED + - |- + SNAPSHOT github.com/databricks/databricks-sdk-go/service/serving.Ai21LabsConfig: "ai21labs_api_key": "description": |- @@ -6365,6 +6520,8 @@ github.com/databricks/databricks-sdk-go/service/serving.ServedModelInputWorkload GPU_LARGE - |- MULTIGPU_MEDIUM + - |- + GPU_XLARGE github.com/databricks/databricks-sdk-go/service/serving.ServingEndpointPermissionLevel: "_": "description": |- @@ -6391,6 +6548,8 @@ github.com/databricks/databricks-sdk-go/service/serving.ServingModelWorkloadType GPU_LARGE - |- MULTIGPU_MEDIUM + - |- + GPU_XLARGE github.com/databricks/databricks-sdk-go/service/serving.TrafficConfig: "routes": "description": |- diff --git a/bundle/internal/schema/annotations_openapi_overrides.yml b/bundle/internal/schema/annotations_openapi_overrides.yml index ff08304f533..d93e6068f46 100644 --- a/bundle/internal/schema/annotations_openapi_overrides.yml +++ b/bundle/internal/schema/annotations_openapi_overrides.yml @@ -935,6 +935,13 @@ github.com/databricks/databricks-sdk-go/service/jobs.JobsHealthRules: "rules": "description": |- PLACEHOLDER +github.com/databricks/databricks-sdk-go/service/jobs.PythonOperatorTaskParameter: + "name": + "description": |- + PLACEHOLDER + "value": + "description": |- + PLACEHOLDER github.com/databricks/databricks-sdk-go/service/jobs.RunJobTask: "python_named_params": "description": |- @@ -975,6 +982,9 @@ github.com/databricks/databricks-sdk-go/service/pipelines.ConnectorOptions: "gdrive_options": "description": |- PLACEHOLDER + "kafka_options": + "description": |- + PLACEHOLDER "sharepoint_options": "description": |- PLACEHOLDER @@ -1031,6 +1041,10 @@ github.com/databricks/databricks-sdk-go/service/pipelines.TableSpecificConfig: "workday_report_parameters": "description": |- PLACEHOLDER +github.com/databricks/databricks-sdk-go/service/pipelines.Transformer: + "json_options": + "description": |- + PLACEHOLDER github.com/databricks/databricks-sdk-go/service/serving.Route: "served_entity_name": "description": |- diff --git a/bundle/internal/validation/generated/enum_fields.go b/bundle/internal/validation/generated/enum_fields.go index bd481f9f2e3..850eb8eedfe 100644 --- a/bundle/internal/validation/generated/enum_fields.go +++ b/bundle/internal/validation/generated/enum_fields.go @@ -135,50 +135,58 @@ var EnumFields = map[string][]string{ "resources.model_serving_endpoints.*.ai_gateway.rate_limits[*].renewal_period": {"minute"}, "resources.model_serving_endpoints.*.config.served_entities[*].external_model.amazon_bedrock_config.bedrock_provider": {"ai21labs", "amazon", "anthropic", "cohere"}, "resources.model_serving_endpoints.*.config.served_entities[*].external_model.provider": {"ai21labs", "amazon-bedrock", "anthropic", "cohere", "custom", "databricks-model-serving", "google-cloud-vertex-ai", "openai", "palm"}, - "resources.model_serving_endpoints.*.config.served_entities[*].workload_type": {"CPU", "GPU_LARGE", "GPU_MEDIUM", "GPU_SMALL", "MULTIGPU_MEDIUM"}, - "resources.model_serving_endpoints.*.config.served_models[*].workload_type": {"CPU", "GPU_LARGE", "GPU_MEDIUM", "GPU_SMALL", "MULTIGPU_MEDIUM"}, + "resources.model_serving_endpoints.*.config.served_entities[*].workload_type": {"CPU", "GPU_LARGE", "GPU_MEDIUM", "GPU_SMALL", "GPU_XLARGE", "MULTIGPU_MEDIUM"}, + "resources.model_serving_endpoints.*.config.served_models[*].workload_type": {"CPU", "GPU_LARGE", "GPU_MEDIUM", "GPU_SMALL", "GPU_XLARGE", "MULTIGPU_MEDIUM"}, "resources.model_serving_endpoints.*.permissions[*].level": {"CAN_MANAGE", "CAN_QUERY", "CAN_VIEW"}, "resources.model_serving_endpoints.*.rate_limits[*].key": {"endpoint", "user"}, "resources.model_serving_endpoints.*.rate_limits[*].renewal_period": {"minute"}, "resources.models.*.permissions[*].level": {"CAN_EDIT", "CAN_MANAGE", "CAN_MANAGE_PRODUCTION_VERSIONS", "CAN_MANAGE_STAGING_VERSIONS", "CAN_READ"}, - "resources.pipelines.*.clusters[*].autoscale.mode": {"ENHANCED", "LEGACY"}, - "resources.pipelines.*.clusters[*].aws_attributes.availability": {"ON_DEMAND", "SPOT", "SPOT_WITH_FALLBACK"}, - "resources.pipelines.*.clusters[*].aws_attributes.ebs_volume_type": {"GENERAL_PURPOSE_SSD", "THROUGHPUT_OPTIMIZED_HDD"}, - "resources.pipelines.*.clusters[*].azure_attributes.availability": {"ON_DEMAND_AZURE", "SPOT_AZURE", "SPOT_WITH_FALLBACK_AZURE"}, - "resources.pipelines.*.clusters[*].gcp_attributes.availability": {"ON_DEMAND_GCP", "PREEMPTIBLE_GCP", "PREEMPTIBLE_WITH_FALLBACK_GCP"}, - "resources.pipelines.*.clusters[*].gcp_attributes.confidential_compute_type": {"CONFIDENTIAL_COMPUTE_TYPE_NONE", "SEV_SNP"}, - "resources.pipelines.*.deployment.kind": {"BUNDLE"}, - "resources.pipelines.*.ingestion_definition.connector_type": {"CDC", "QUERY_BASED"}, - "resources.pipelines.*.ingestion_definition.full_refresh_window.days_of_week[*]": {"FRIDAY", "MONDAY", "SATURDAY", "SUNDAY", "THURSDAY", "TUESDAY", "WEDNESDAY"}, - "resources.pipelines.*.ingestion_definition.objects[*].report.table_configuration.scd_type": {"APPEND_ONLY", "SCD_TYPE_1", "SCD_TYPE_2"}, - "resources.pipelines.*.ingestion_definition.objects[*].schema.connector_options.gdrive_options.entity_type": {"FILE", "FILE_METADATA", "PERMISSION"}, - "resources.pipelines.*.ingestion_definition.objects[*].schema.connector_options.gdrive_options.file_ingestion_options.format": {"AVRO", "BINARYFILE", "CSV", "EXCEL", "JSON", "ORC", "PARQUET", "XML"}, - "resources.pipelines.*.ingestion_definition.objects[*].schema.connector_options.gdrive_options.file_ingestion_options.schema_evolution_mode": {"ADD_NEW_COLUMNS", "ADD_NEW_COLUMNS_WITH_TYPE_WIDENING", "FAIL_ON_NEW_COLUMNS", "NONE", "RESCUE"}, - "resources.pipelines.*.ingestion_definition.objects[*].schema.connector_options.outlook_options.attachment_mode": {"ALL", "INLINE_ONLY", "NONE", "NON_INLINE_ONLY"}, - "resources.pipelines.*.ingestion_definition.objects[*].schema.connector_options.outlook_options.body_format": {"TEXT_HTML", "TEXT_PLAIN"}, - "resources.pipelines.*.ingestion_definition.objects[*].schema.connector_options.sharepoint_options.entity_type": {"FILE", "FILE_METADATA", "LIST", "PERMISSION"}, - "resources.pipelines.*.ingestion_definition.objects[*].schema.connector_options.sharepoint_options.file_ingestion_options.format": {"AVRO", "BINARYFILE", "CSV", "EXCEL", "JSON", "ORC", "PARQUET", "XML"}, - "resources.pipelines.*.ingestion_definition.objects[*].schema.connector_options.sharepoint_options.file_ingestion_options.schema_evolution_mode": {"ADD_NEW_COLUMNS", "ADD_NEW_COLUMNS_WITH_TYPE_WIDENING", "FAIL_ON_NEW_COLUMNS", "NONE", "RESCUE"}, - "resources.pipelines.*.ingestion_definition.objects[*].schema.connector_options.tiktok_ads_options.data_level": {"AUCTION_AD", "AUCTION_ADGROUP", "AUCTION_ADVERTISER", "AUCTION_CAMPAIGN"}, - "resources.pipelines.*.ingestion_definition.objects[*].schema.connector_options.tiktok_ads_options.report_type": {"AUDIENCE", "BASIC", "BUSINESS_CENTER", "DSA", "GMV_MAX", "PLAYABLE_AD"}, - "resources.pipelines.*.ingestion_definition.objects[*].schema.table_configuration.scd_type": {"APPEND_ONLY", "SCD_TYPE_1", "SCD_TYPE_2"}, - "resources.pipelines.*.ingestion_definition.objects[*].table.connector_options.gdrive_options.entity_type": {"FILE", "FILE_METADATA", "PERMISSION"}, - "resources.pipelines.*.ingestion_definition.objects[*].table.connector_options.gdrive_options.file_ingestion_options.format": {"AVRO", "BINARYFILE", "CSV", "EXCEL", "JSON", "ORC", "PARQUET", "XML"}, - "resources.pipelines.*.ingestion_definition.objects[*].table.connector_options.gdrive_options.file_ingestion_options.schema_evolution_mode": {"ADD_NEW_COLUMNS", "ADD_NEW_COLUMNS_WITH_TYPE_WIDENING", "FAIL_ON_NEW_COLUMNS", "NONE", "RESCUE"}, - "resources.pipelines.*.ingestion_definition.objects[*].table.connector_options.outlook_options.attachment_mode": {"ALL", "INLINE_ONLY", "NONE", "NON_INLINE_ONLY"}, - "resources.pipelines.*.ingestion_definition.objects[*].table.connector_options.outlook_options.body_format": {"TEXT_HTML", "TEXT_PLAIN"}, - "resources.pipelines.*.ingestion_definition.objects[*].table.connector_options.sharepoint_options.entity_type": {"FILE", "FILE_METADATA", "LIST", "PERMISSION"}, - "resources.pipelines.*.ingestion_definition.objects[*].table.connector_options.sharepoint_options.file_ingestion_options.format": {"AVRO", "BINARYFILE", "CSV", "EXCEL", "JSON", "ORC", "PARQUET", "XML"}, - "resources.pipelines.*.ingestion_definition.objects[*].table.connector_options.sharepoint_options.file_ingestion_options.schema_evolution_mode": {"ADD_NEW_COLUMNS", "ADD_NEW_COLUMNS_WITH_TYPE_WIDENING", "FAIL_ON_NEW_COLUMNS", "NONE", "RESCUE"}, - "resources.pipelines.*.ingestion_definition.objects[*].table.connector_options.tiktok_ads_options.data_level": {"AUCTION_AD", "AUCTION_ADGROUP", "AUCTION_ADVERTISER", "AUCTION_CAMPAIGN"}, - "resources.pipelines.*.ingestion_definition.objects[*].table.connector_options.tiktok_ads_options.report_type": {"AUDIENCE", "BASIC", "BUSINESS_CENTER", "DSA", "GMV_MAX", "PLAYABLE_AD"}, - "resources.pipelines.*.ingestion_definition.objects[*].table.table_configuration.scd_type": {"APPEND_ONLY", "SCD_TYPE_1", "SCD_TYPE_2"}, - "resources.pipelines.*.ingestion_definition.source_type": {"BIGQUERY", "CONFLUENCE", "DYNAMICS365", "FOREIGN_CATALOG", "GA4_RAW_DATA", "GOOGLE_DRIVE", "JIRA", "MANAGED_POSTGRESQL", "META_MARKETING", "MYSQL", "NETSUITE", "ORACLE", "POSTGRESQL", "SALESFORCE", "SERVICENOW", "SHAREPOINT", "SQLSERVER", "TERADATA", "WORKDAY_RAAS", "ZENDESK"}, - "resources.pipelines.*.ingestion_definition.table_configuration.scd_type": {"APPEND_ONLY", "SCD_TYPE_1", "SCD_TYPE_2"}, - "resources.pipelines.*.permissions[*].level": {"CAN_MANAGE", "CAN_RUN", "CAN_VIEW", "IS_OWNER"}, - "resources.pipelines.*.restart_window.days_of_week[*]": {"FRIDAY", "MONDAY", "SATURDAY", "SUNDAY", "THURSDAY", "TUESDAY", "WEDNESDAY"}, + "resources.pipelines.*.clusters[*].autoscale.mode": {"ENHANCED", "LEGACY"}, + "resources.pipelines.*.clusters[*].aws_attributes.availability": {"ON_DEMAND", "SPOT", "SPOT_WITH_FALLBACK"}, + "resources.pipelines.*.clusters[*].aws_attributes.ebs_volume_type": {"GENERAL_PURPOSE_SSD", "THROUGHPUT_OPTIMIZED_HDD"}, + "resources.pipelines.*.clusters[*].azure_attributes.availability": {"ON_DEMAND_AZURE", "SPOT_AZURE", "SPOT_WITH_FALLBACK_AZURE"}, + "resources.pipelines.*.clusters[*].gcp_attributes.availability": {"ON_DEMAND_GCP", "PREEMPTIBLE_GCP", "PREEMPTIBLE_WITH_FALLBACK_GCP"}, + "resources.pipelines.*.clusters[*].gcp_attributes.confidential_compute_type": {"CONFIDENTIAL_COMPUTE_TYPE_NONE", "SEV_SNP"}, + "resources.pipelines.*.deployment.kind": {"BUNDLE"}, + "resources.pipelines.*.ingestion_definition.connector_type": {"CDC", "QUERY_BASED"}, + "resources.pipelines.*.ingestion_definition.full_refresh_window.days_of_week[*]": {"FRIDAY", "MONDAY", "SATURDAY", "SUNDAY", "THURSDAY", "TUESDAY", "WEDNESDAY"}, + "resources.pipelines.*.ingestion_definition.objects[*].report.table_configuration.scd_type": {"APPEND_ONLY", "SCD_TYPE_1", "SCD_TYPE_2"}, + "resources.pipelines.*.ingestion_definition.objects[*].schema.connector_options.gdrive_options.entity_type": {"FILE", "FILE_METADATA", "PERMISSION"}, + "resources.pipelines.*.ingestion_definition.objects[*].schema.connector_options.gdrive_options.file_ingestion_options.format": {"AVRO", "BINARYFILE", "CSV", "EXCEL", "JSON", "ORC", "PARQUET", "XML"}, + "resources.pipelines.*.ingestion_definition.objects[*].schema.connector_options.gdrive_options.file_ingestion_options.schema_evolution_mode": {"ADD_NEW_COLUMNS", "ADD_NEW_COLUMNS_WITH_TYPE_WIDENING", "FAIL_ON_NEW_COLUMNS", "NONE", "RESCUE"}, + "resources.pipelines.*.ingestion_definition.objects[*].schema.connector_options.kafka_options.key_transformer.format": {"JSON", "STRING"}, + "resources.pipelines.*.ingestion_definition.objects[*].schema.connector_options.kafka_options.key_transformer.json_options.schema_evolution_mode": {"ADD_NEW_COLUMNS", "ADD_NEW_COLUMNS_WITH_TYPE_WIDENING", "FAIL_ON_NEW_COLUMNS", "NONE", "RESCUE"}, + "resources.pipelines.*.ingestion_definition.objects[*].schema.connector_options.kafka_options.value_transformer.format": {"JSON", "STRING"}, + "resources.pipelines.*.ingestion_definition.objects[*].schema.connector_options.kafka_options.value_transformer.json_options.schema_evolution_mode": {"ADD_NEW_COLUMNS", "ADD_NEW_COLUMNS_WITH_TYPE_WIDENING", "FAIL_ON_NEW_COLUMNS", "NONE", "RESCUE"}, + "resources.pipelines.*.ingestion_definition.objects[*].schema.connector_options.outlook_options.attachment_mode": {"ALL", "INLINE_ONLY", "NONE", "NON_INLINE_ONLY"}, + "resources.pipelines.*.ingestion_definition.objects[*].schema.connector_options.outlook_options.body_format": {"TEXT_HTML", "TEXT_PLAIN"}, + "resources.pipelines.*.ingestion_definition.objects[*].schema.connector_options.sharepoint_options.entity_type": {"FILE", "FILE_METADATA", "LIST", "PERMISSION"}, + "resources.pipelines.*.ingestion_definition.objects[*].schema.connector_options.sharepoint_options.file_ingestion_options.format": {"AVRO", "BINARYFILE", "CSV", "EXCEL", "JSON", "ORC", "PARQUET", "XML"}, + "resources.pipelines.*.ingestion_definition.objects[*].schema.connector_options.sharepoint_options.file_ingestion_options.schema_evolution_mode": {"ADD_NEW_COLUMNS", "ADD_NEW_COLUMNS_WITH_TYPE_WIDENING", "FAIL_ON_NEW_COLUMNS", "NONE", "RESCUE"}, + "resources.pipelines.*.ingestion_definition.objects[*].schema.connector_options.tiktok_ads_options.data_level": {"AUCTION_AD", "AUCTION_ADGROUP", "AUCTION_ADVERTISER", "AUCTION_CAMPAIGN"}, + "resources.pipelines.*.ingestion_definition.objects[*].schema.connector_options.tiktok_ads_options.report_type": {"AUDIENCE", "BASIC", "BUSINESS_CENTER", "DSA", "GMV_MAX", "PLAYABLE_AD"}, + "resources.pipelines.*.ingestion_definition.objects[*].schema.table_configuration.scd_type": {"APPEND_ONLY", "SCD_TYPE_1", "SCD_TYPE_2"}, + "resources.pipelines.*.ingestion_definition.objects[*].table.connector_options.gdrive_options.entity_type": {"FILE", "FILE_METADATA", "PERMISSION"}, + "resources.pipelines.*.ingestion_definition.objects[*].table.connector_options.gdrive_options.file_ingestion_options.format": {"AVRO", "BINARYFILE", "CSV", "EXCEL", "JSON", "ORC", "PARQUET", "XML"}, + "resources.pipelines.*.ingestion_definition.objects[*].table.connector_options.gdrive_options.file_ingestion_options.schema_evolution_mode": {"ADD_NEW_COLUMNS", "ADD_NEW_COLUMNS_WITH_TYPE_WIDENING", "FAIL_ON_NEW_COLUMNS", "NONE", "RESCUE"}, + "resources.pipelines.*.ingestion_definition.objects[*].table.connector_options.kafka_options.key_transformer.format": {"JSON", "STRING"}, + "resources.pipelines.*.ingestion_definition.objects[*].table.connector_options.kafka_options.key_transformer.json_options.schema_evolution_mode": {"ADD_NEW_COLUMNS", "ADD_NEW_COLUMNS_WITH_TYPE_WIDENING", "FAIL_ON_NEW_COLUMNS", "NONE", "RESCUE"}, + "resources.pipelines.*.ingestion_definition.objects[*].table.connector_options.kafka_options.value_transformer.format": {"JSON", "STRING"}, + "resources.pipelines.*.ingestion_definition.objects[*].table.connector_options.kafka_options.value_transformer.json_options.schema_evolution_mode": {"ADD_NEW_COLUMNS", "ADD_NEW_COLUMNS_WITH_TYPE_WIDENING", "FAIL_ON_NEW_COLUMNS", "NONE", "RESCUE"}, + "resources.pipelines.*.ingestion_definition.objects[*].table.connector_options.outlook_options.attachment_mode": {"ALL", "INLINE_ONLY", "NONE", "NON_INLINE_ONLY"}, + "resources.pipelines.*.ingestion_definition.objects[*].table.connector_options.outlook_options.body_format": {"TEXT_HTML", "TEXT_PLAIN"}, + "resources.pipelines.*.ingestion_definition.objects[*].table.connector_options.sharepoint_options.entity_type": {"FILE", "FILE_METADATA", "LIST", "PERMISSION"}, + "resources.pipelines.*.ingestion_definition.objects[*].table.connector_options.sharepoint_options.file_ingestion_options.format": {"AVRO", "BINARYFILE", "CSV", "EXCEL", "JSON", "ORC", "PARQUET", "XML"}, + "resources.pipelines.*.ingestion_definition.objects[*].table.connector_options.sharepoint_options.file_ingestion_options.schema_evolution_mode": {"ADD_NEW_COLUMNS", "ADD_NEW_COLUMNS_WITH_TYPE_WIDENING", "FAIL_ON_NEW_COLUMNS", "NONE", "RESCUE"}, + "resources.pipelines.*.ingestion_definition.objects[*].table.connector_options.tiktok_ads_options.data_level": {"AUCTION_AD", "AUCTION_ADGROUP", "AUCTION_ADVERTISER", "AUCTION_CAMPAIGN"}, + "resources.pipelines.*.ingestion_definition.objects[*].table.connector_options.tiktok_ads_options.report_type": {"AUDIENCE", "BASIC", "BUSINESS_CENTER", "DSA", "GMV_MAX", "PLAYABLE_AD"}, + "resources.pipelines.*.ingestion_definition.objects[*].table.table_configuration.scd_type": {"APPEND_ONLY", "SCD_TYPE_1", "SCD_TYPE_2"}, + "resources.pipelines.*.ingestion_definition.source_type": {"BIGQUERY", "CONFLUENCE", "DYNAMICS365", "FOREIGN_CATALOG", "GA4_RAW_DATA", "GOOGLE_DRIVE", "JIRA", "MANAGED_POSTGRESQL", "META_MARKETING", "MYSQL", "NETSUITE", "ORACLE", "POSTGRESQL", "SALESFORCE", "SERVICENOW", "SHAREPOINT", "SQLSERVER", "TERADATA", "WORKDAY_RAAS", "ZENDESK"}, + "resources.pipelines.*.ingestion_definition.table_configuration.scd_type": {"APPEND_ONLY", "SCD_TYPE_1", "SCD_TYPE_2"}, + "resources.pipelines.*.permissions[*].level": {"CAN_MANAGE", "CAN_RUN", "CAN_VIEW", "IS_OWNER"}, + "resources.pipelines.*.restart_window.days_of_week[*]": {"FRIDAY", "MONDAY", "SATURDAY", "SUNDAY", "THURSDAY", "TUESDAY", "WEDNESDAY"}, "resources.postgres_endpoints.*.endpoint_type": {"ENDPOINT_TYPE_READ_ONLY", "ENDPOINT_TYPE_READ_WRITE"}, diff --git a/bundle/schema/jsonschema.json b/bundle/schema/jsonschema.json index 414e70fedd2..2a7f76aac85 100644 --- a/bundle/schema/jsonschema.json +++ b/bundle/schema/jsonschema.json @@ -160,7 +160,9 @@ }, "git_source": { "description": "Git source configuration for app deployments. Specifies which git reference (branch, tag, or commit)\nto use when deploying the app. Used in conjunction with git_repository to deploy code directly from git.\nThe source_code_path within git_source specifies the relative path to the app code within the repository.", - "$ref": "#/$defs/github.com/databricks/databricks-sdk-go/service/apps.GitSource" + "$ref": "#/$defs/github.com/databricks/databricks-sdk-go/service/apps.GitSource", + "x-databricks-preview": "PRIVATE", + "doNotSuggest": true }, "lifecycle": { "description": "Lifecycle is a struct that contains the lifecycle settings for a resource. It controls the behavior of the resource when it is deployed or destroyed.", @@ -178,7 +180,9 @@ "$ref": "#/$defs/slice/github.com/databricks/databricks-sdk-go/service/apps.AppResource" }, "source_code_path": { - "$ref": "#/$defs/string" + "$ref": "#/$defs/string", + "x-databricks-preview": "PRIVATE", + "doNotSuggest": true }, "space": { "description": "Name of the space this app belongs to.", @@ -4212,7 +4216,9 @@ "READ_METADATA", "MANAGE_ACCESS", "MANAGE_ACCESS_CONTROL", - "CREATE_SERVICE" + "CREATE_SERVICE", + "CREATE_FEATURE", + "READ_FEATURE" ] }, { @@ -4724,7 +4730,7 @@ "oneOf": [ { "type": "string", - "description": "Data security mode decides what data governance model to use when accessing data\nfrom a cluster.\n\nThe following modes can only be used when `kind = CLASSIC_PREVIEW`.\n* `DATA_SECURITY_MODE_AUTO`: Databricks will choose the most appropriate access mode depending on your compute configuration.\n* `DATA_SECURITY_MODE_STANDARD`: Alias for `USER_ISOLATION`.\n* `DATA_SECURITY_MODE_DEDICATED`: Alias for `SINGLE_USER`.\n\nThe following modes can be used regardless of `kind`.\n* `NONE`: No security isolation for multiple users sharing the cluster. Data governance features are not available in this mode.\n* `SINGLE_USER`: A secure cluster that can only be exclusively used by a single user specified in `single_user_name`. Most programming languages, cluster features and data governance features are available in this mode.\n* `USER_ISOLATION`: A secure cluster that can be shared by multiple users. Cluster users are fully isolated so that they cannot see each other's data and credentials. Most data governance features are supported in this mode. But programming languages and cluster features might be limited.\n\nThe following modes are deprecated starting with Databricks Runtime 15.0 and\nwill be removed for future Databricks Runtime versions:\n\n* `LEGACY_TABLE_ACL`: This mode is for users migrating from legacy Table ACL clusters.\n* `LEGACY_PASSTHROUGH`: This mode is for users migrating from legacy Passthrough on high concurrency clusters.\n* `LEGACY_SINGLE_USER`: This mode is for users migrating from legacy Passthrough on standard clusters.\n* `LEGACY_SINGLE_USER_STANDARD`: This mode provides a way that doesn’t have UC nor passthrough enabled.", + "description": "Data security mode decides what data governance model to use when accessing data\nfrom a cluster.\n\n* `DATA_SECURITY_MODE_AUTO`: Databricks will choose the most appropriate access mode depending on your compute configuration.\n* `DATA_SECURITY_MODE_STANDARD`: A secure cluster that can be shared by multiple users. Cluster users are fully isolated so that they cannot see each other’s data and credentials. Most data governance features are supported in this mode. But programming languages and cluster features might be limited.\n* `DATA_SECURITY_MODE_DEDICATED`: A secure cluster that can only be exclusively used by a single user specified in `single_user_name`. Most programming languages, cluster features and data governance features are available in this mode.\n\nThe following modes are legacy aliases for the above modes:\n\n* `USER_ISOLATION`: Legacy alias for `DATA_SECURITY_MODE_STANDARD`.\n* `SINGLE_USER`: Legacy alias for `DATA_SECURITY_MODE_DEDICATED`.\n\nThe following modes are deprecated starting with Databricks Runtime 15.0 and\nwill be removed for future Databricks Runtime versions:\n\n* `LEGACY_TABLE_ACL`: This mode is for users migrating from legacy Table ACL clusters.\n* `LEGACY_PASSTHROUGH`: This mode is for users migrating from legacy Passthrough on high concurrency clusters.\n* `LEGACY_SINGLE_USER`: This mode is for users migrating from legacy Passthrough on standard clusters.\n* `LEGACY_SINGLE_USER_STANDARD`: This mode provides a way that doesn’t have UC nor passthrough enabled.", "enum": [ "NONE", "SINGLE_USER", @@ -4832,7 +4838,7 @@ "description": "The environment entity used to preserve serverless environment side panel, jobs' environment for non-notebook task, and SDP's environment for classic and serverless pipelines.\nIn this minimal environment spec, only pip and java dependencies are supported.", "properties": { "base_environment": { - "description": "The base environment this environment is built on top of. A base environment defines the environment version and a\nlist of dependencies for serverless compute. The value can be a file path to a custom `env.yaml` file\n(e.g., `/Workspace/path/to/env.yaml`). Support for a Databricks-provided base environment ID\n(e.g., `workspace-base-environments/databricks_ai_v4`) and workspace base environment ID\n(e.g., `workspace-base-environments/dbe_b849b66e-b31a-4cb5-b161-1f2b10877fb7`) is in Beta.\nEither `environment_version` or `base_environment` can be provided. For more information, see", + "description": "The base environment this environment is built on top of. A base environment defines the environment version and a\nlist of dependencies for serverless compute. The value can be a file path to a custom `env.yaml` file\n(e.g., `/Workspace/path/to/env.yaml`). Support for a Databricks-provided base environment ID\n(e.g., `workspace-base-environments/databricks_ai_v4`) and workspace base environment ID\n(e.g., `workspace-base-environments/dbe_b849b66e-b31a-4cb5-b161-1f2b10877fb7`) is in Beta.\nEither `environment_version` or `base_environment` can be provided.\nFor more information about Databricks-provided base environments, see the\n[list workspace base environments](:method:Environments/ListWorkspaceBaseEnvironments) API.\nFor more information, see", "$ref": "#/$defs/string" }, "client": { @@ -5414,7 +5420,7 @@ "STOPPED", "UPDATING", "FAILING_OVER", - "MIGRATING" + "UPGRADING" ] }, { @@ -6853,6 +6859,22 @@ "full_refresh": { "description": "If true, triggers a full refresh on the spark declarative pipeline.", "$ref": "#/$defs/bool" + }, + "full_refresh_selection": { + "description": "A list of tables to update with fullRefresh.", + "$ref": "#/$defs/slice/string" + }, + "refresh_flow_selection": { + "description": "Flow names to selectively refresh. These are unioned with other selective refresh\noptions (refresh_selection, full_refresh_selection) to determine the final set of flows to refresh.", + "$ref": "#/$defs/slice/string" + }, + "refresh_selection": { + "description": "A list of tables to update without fullRefresh.", + "$ref": "#/$defs/slice/string" + }, + "reset_checkpoint_selection": { + "description": "A list of streaming flows to reset checkpoints without clearing data.", + "$ref": "#/$defs/slice/string" } }, "additionalProperties": false @@ -6872,9 +6894,25 @@ "description": "If true, triggers a full refresh on the spark declarative pipeline.", "$ref": "#/$defs/bool" }, + "full_refresh_selection": { + "description": "A list of tables to update with fullRefresh.", + "$ref": "#/$defs/slice/string" + }, "pipeline_id": { "description": "The full name of the pipeline task to execute.", "$ref": "#/$defs/string" + }, + "refresh_flow_selection": { + "description": "Flow names to selectively refresh. These are unioned with other selective refresh\noptions (refresh_selection, full_refresh_selection) to determine the final set of flows to refresh.", + "$ref": "#/$defs/slice/string" + }, + "refresh_selection": { + "description": "A list of tables to update without fullRefresh.", + "$ref": "#/$defs/slice/string" + }, + "reset_checkpoint_selection": { + "description": "A list of streaming flows to reset checkpoints without clearing data.", + "$ref": "#/$defs/slice/string" } }, "additionalProperties": false, @@ -6986,6 +7024,48 @@ } ] }, + "jobs.PythonOperatorTask": { + "oneOf": [ + { + "type": "object", + "properties": { + "main": { + "description": "Fully qualified name of the main class or function.\nFor example, `my_project.my_function` or `my_project.MyOperator`.", + "$ref": "#/$defs/string" + }, + "parameters": { + "description": "An ordered list of task parameters.\nTODO(JOBS-30885): Add limits for parameters.", + "$ref": "#/$defs/slice/github.com/databricks/databricks-sdk-go/service/jobs.PythonOperatorTaskParameter" + } + }, + "additionalProperties": false + }, + { + "type": "string", + "pattern": "\\$\\{(var(\\.[a-zA-Z]+([-_]?[a-zA-Z0-9]+)*(\\[[0-9]+\\])*)+)\\}" + } + ] + }, + "jobs.PythonOperatorTaskParameter": { + "oneOf": [ + { + "type": "object", + "properties": { + "name": { + "$ref": "#/$defs/string" + }, + "value": { + "$ref": "#/$defs/string" + } + }, + "additionalProperties": false + }, + { + "type": "string", + "pattern": "\\$\\{(var(\\.[a-zA-Z]+([-_]?[a-zA-Z0-9]+)*(\\[[0-9]+\\])*)+)\\}" + } + ] + }, "jobs.PythonWheelTask": { "oneOf": [ { @@ -7581,9 +7661,7 @@ }, "disabled": { "description": "An optional flag to disable the task. If set to true, the task will not run even if it is part of a job.", - "$ref": "#/$defs/bool", - "x-databricks-preview": "PRIVATE", - "doNotSuggest": true + "$ref": "#/$defs/bool" }, "email_notifications": { "description": "An optional set of email addresses that is notified when runs of this task begin or complete as well as when this task is deleted. The default behavior is to not send any emails.", @@ -7645,6 +7723,12 @@ "description": "The task triggers a Power BI semantic model update when the `power_bi_task` field is present.", "$ref": "#/$defs/github.com/databricks/databricks-sdk-go/service/jobs.PowerBiTask" }, + "python_operator_task": { + "description": "The task runs a Python operator task.", + "$ref": "#/$defs/github.com/databricks/databricks-sdk-go/service/jobs.PythonOperatorTask", + "x-databricks-preview": "PRIVATE", + "doNotSuggest": true + }, "python_wheel_task": { "description": "The task runs a Python wheel when the `python_wheel_task` field is present.", "$ref": "#/$defs/github.com/databricks/databricks-sdk-go/service/jobs.PythonWheelTask" @@ -8070,6 +8154,11 @@ "description": "Jira specific options for ingestion", "$ref": "#/$defs/github.com/databricks/databricks-sdk-go/service/pipelines.JiraConnectorOptions" }, + "kafka_options": { + "$ref": "#/$defs/github.com/databricks/databricks-sdk-go/service/pipelines.KafkaOptions", + "x-databricks-preview": "PRIVATE", + "doNotSuggest": true + }, "meta_ads_options": { "description": "Meta Marketing (Meta Ads) specific options for ingestion", "$ref": "#/$defs/github.com/databricks/databricks-sdk-go/service/pipelines.MetaMarketingOptions" @@ -8333,7 +8422,8 @@ "EXCEL", "PARQUET", "AVRO", - "ORC" + "ORC", + "FILE" ] }, { @@ -8480,7 +8570,9 @@ "enum": [ "FILE", "FILE_METADATA", - "PERMISSION" + "PERMISSION", + "FILE_PERMISSION", + "GROUP_MEMBERSHIP" ] }, { @@ -8833,6 +8925,86 @@ } ] }, + "pipelines.JsonTransformerOptions": { + "oneOf": [ + { + "type": "object", + "properties": { + "as_variant": { + "description": "Parse the entire value as a single Variant column.", + "$ref": "#/$defs/bool" + }, + "schema": { + "description": "Inline schema string for JSON parsing (Spark DDL format).", + "$ref": "#/$defs/string" + }, + "schema_evolution_mode": { + "description": "(Optional) Schema evolution mode for schema inference.", + "$ref": "#/$defs/github.com/databricks/databricks-sdk-go/service/pipelines.FileIngestionOptionsSchemaEvolutionMode" + }, + "schema_file_path": { + "description": "Path to a schema file (.ddl).", + "$ref": "#/$defs/string" + }, + "schema_hints": { + "description": "(Optional) Schema hints as a comma-separated string of \"column_name type\" pairs.", + "$ref": "#/$defs/string" + } + }, + "additionalProperties": false + }, + { + "type": "string", + "pattern": "\\$\\{(var(\\.[a-zA-Z]+([-_]?[a-zA-Z0-9]+)*(\\[[0-9]+\\])*)+)\\}" + } + ] + }, + "pipelines.KafkaOptions": { + "oneOf": [ + { + "type": "object", + "properties": { + "client_config": { + "description": "Undocumented backdoor mechanism for overriding parameters\nto pass to the Kafka client.\nThis is not supported and may break at any time.", + "$ref": "#/$defs/map/string", + "x-databricks-preview": "PRIVATE", + "doNotSuggest": true + }, + "key_transformer": { + "description": "(Optional) Transformer for the message key.\nIf not specified, the key is left as raw bytes.", + "$ref": "#/$defs/github.com/databricks/databricks-sdk-go/service/pipelines.Transformer" + }, + "max_offsets_per_trigger": { + "description": "Internal option to control the maximum number of offsets to process per trigger.", + "$ref": "#/$defs/int64", + "x-databricks-preview": "PRIVATE", + "doNotSuggest": true + }, + "starting_offset": { + "description": "(Optional) Where to begin reading when no checkpoint exists.\nValid values: \"latest\" and \"earliest\". Defaults to \"latest\".", + "$ref": "#/$defs/string" + }, + "topic_pattern": { + "description": "Java regex pattern to subscribe to matching topics.\nOnly one of topics or topic_pattern must be specified.", + "$ref": "#/$defs/string" + }, + "topics": { + "description": "Topics to subscribe to.\nOnly one of topics or topic_pattern must be specified.", + "$ref": "#/$defs/slice/string" + }, + "value_transformer": { + "description": "(Optional) Transformer for the message value.\nIf not specified, the value is left as raw bytes.", + "$ref": "#/$defs/github.com/databricks/databricks-sdk-go/service/pipelines.Transformer" + } + }, + "additionalProperties": false + }, + { + "type": "string", + "pattern": "\\$\\{(var(\\.[a-zA-Z]+([-_]?[a-zA-Z0-9]+)*(\\[[0-9]+\\])*)+)\\}" + } + ] + }, "pipelines.ManualTrigger": { "oneOf": [ { @@ -9553,7 +9725,9 @@ "FILE", "FILE_METADATA", "PERMISSION", - "LIST" + "LIST", + "FILE_PERMISSION", + "GROUP_MEMBERSHIP" ] }, { @@ -9833,6 +10007,45 @@ } ] }, + "pipelines.Transformer": { + "oneOf": [ + { + "type": "object", + "description": "Specifies how to transform binary data into structured data.", + "properties": { + "format": { + "description": "Required: the wire format of the data.", + "$ref": "#/$defs/github.com/databricks/databricks-sdk-go/service/pipelines.TransformerFormat" + }, + "json_options": { + "$ref": "#/$defs/github.com/databricks/databricks-sdk-go/service/pipelines.JsonTransformerOptions" + } + }, + "additionalProperties": false + }, + { + "type": "string", + "pattern": "\\$\\{(var(\\.[a-zA-Z]+([-_]?[a-zA-Z0-9]+)*(\\[[0-9]+\\])*)+)\\}" + } + ] + }, + "pipelines.TransformerFormat": { + "oneOf": [ + { + "type": "string", + "enum": [ + "STRING", + "JSON", + "AVRO", + "PROTOBUF" + ] + }, + { + "type": "string", + "pattern": "\\$\\{(var(\\.[a-zA-Z]+([-_]?[a-zA-Z0-9]+)*(\\[[0-9]+\\])*)+)\\}" + } + ] + }, "pipelines.ZendeskSupportOptions": { "oneOf": [ { @@ -9923,12 +10136,15 @@ "type": "object", "properties": { "budget_policy_id": { + "description": "Budget policy to set on the newly created pipeline.", "$ref": "#/$defs/string" }, "storage_catalog": { + "description": "UC catalog for the pipeline to store intermediate files (checkpoints, event logs etc).\nThis needs to be a standard catalog where the user has permissions to create Delta tables.", "$ref": "#/$defs/string" }, "storage_schema": { + "description": "UC schema for the pipeline to store intermediate files (checkpoints, event logs etc).\nThis needs to be in the standard catalog where the user has permissions to create Delta tables.", "$ref": "#/$defs/string" } }, @@ -9998,7 +10214,21 @@ ] }, "postgres.SyncedTableSyncedTableSpecSyncedTableSchedulingPolicy": { - "type": "string" + "oneOf": [ + { + "type": "string", + "description": "Scheduling policy of the synced table's underlying pipeline.", + "enum": [ + "CONTINUOUS", + "TRIGGERED", + "SNAPSHOT" + ] + }, + { + "type": "string", + "pattern": "\\$\\{(var(\\.[a-zA-Z]+([-_]?[a-zA-Z0-9]+)*(\\[[0-9]+\\])*)+)\\}" + } + ] }, "serving.Ai21LabsConfig": { "oneOf": [ @@ -11061,7 +11291,8 @@ "GPU_MEDIUM", "GPU_SMALL", "GPU_LARGE", - "MULTIGPU_MEDIUM" + "MULTIGPU_MEDIUM", + "GPU_XLARGE" ] }, { @@ -11097,7 +11328,8 @@ "GPU_MEDIUM", "GPU_SMALL", "GPU_LARGE", - "MULTIGPU_MEDIUM" + "MULTIGPU_MEDIUM", + "GPU_XLARGE" ] }, { @@ -12556,6 +12788,20 @@ } ] }, + "jobs.PythonOperatorTaskParameter": { + "oneOf": [ + { + "type": "array", + "items": { + "$ref": "#/$defs/github.com/databricks/databricks-sdk-go/service/jobs.PythonOperatorTaskParameter" + } + }, + { + "type": "string", + "pattern": "\\$\\{(var(\\.[a-zA-Z]+([-_]?[a-zA-Z0-9]+)*(\\[[0-9]+\\])*)+)\\}" + } + ] + }, "jobs.SqlTaskSubscription": { "oneOf": [ { diff --git a/bundle/schema/jsonschema_for_docs.json b/bundle/schema/jsonschema_for_docs.json index ff64ac25c26..e5caee8b64a 100644 --- a/bundle/schema/jsonschema_for_docs.json +++ b/bundle/schema/jsonschema_for_docs.json @@ -113,6 +113,8 @@ "git_source": { "description": "Git source configuration for app deployments. Specifies which git reference (branch, tag, or commit)\nto use when deploying the app. Used in conjunction with git_repository to deploy code directly from git.\nThe source_code_path within git_source specifies the relative path to the app code within the repository.", "$ref": "#/$defs/github.com/databricks/databricks-sdk-go/service/apps.GitSource", + "x-databricks-preview": "PRIVATE", + "doNotSuggest": true, "x-since-version": "v0.290.0" }, "lifecycle": { @@ -136,6 +138,8 @@ }, "source_code_path": { "$ref": "#/$defs/string", + "x-databricks-preview": "PRIVATE", + "doNotSuggest": true, "x-since-version": "v0.239.0" }, "space": { @@ -1368,6 +1372,10 @@ "$ref": "#/$defs/string", "x-since-version": "v0.287.0" }, + "replace_existing": { + "$ref": "#/$defs/bool", + "x-since-version": "v1.0.0" + }, "source_branch": { "$ref": "#/$defs/string", "x-since-version": "v0.287.0" @@ -1395,19 +1403,24 @@ "type": "object", "properties": { "branch": { - "$ref": "#/$defs/string" + "$ref": "#/$defs/string", + "x-since-version": "v1.0.0" }, "catalog_id": { - "$ref": "#/$defs/string" + "$ref": "#/$defs/string", + "x-since-version": "v1.0.0" }, "create_database_if_missing": { - "$ref": "#/$defs/bool" + "$ref": "#/$defs/bool", + "x-since-version": "v1.0.0" }, "lifecycle": { - "$ref": "#/$defs/github.com/databricks/cli/bundle/config/resources.Lifecycle" + "$ref": "#/$defs/github.com/databricks/cli/bundle/config/resources.Lifecycle", + "x-since-version": "v1.0.0" }, "postgres_database": { - "$ref": "#/$defs/string" + "$ref": "#/$defs/string", + "x-since-version": "v1.0.0" } }, "additionalProperties": false, @@ -1455,6 +1468,10 @@ "$ref": "#/$defs/string", "x-since-version": "v0.287.0" }, + "replace_existing": { + "$ref": "#/$defs/bool", + "x-since-version": "v1.0.0" + }, "settings": { "$ref": "#/$defs/github.com/databricks/databricks-sdk-go/service/postgres.EndpointSettings", "x-since-version": "v0.287.0" @@ -1524,6 +1541,59 @@ "project_id" ] }, + "resources.PostgresSyncedTable": { + "type": "object", + "properties": { + "branch": { + "$ref": "#/$defs/string", + "x-since-version": "v1.0.0" + }, + "create_database_objects_if_missing": { + "$ref": "#/$defs/bool", + "x-since-version": "v1.0.0" + }, + "existing_pipeline_id": { + "$ref": "#/$defs/string", + "x-since-version": "v1.0.0" + }, + "lifecycle": { + "$ref": "#/$defs/github.com/databricks/cli/bundle/config/resources.Lifecycle", + "x-since-version": "v1.0.0" + }, + "new_pipeline_spec": { + "$ref": "#/$defs/github.com/databricks/databricks-sdk-go/service/postgres.NewPipelineSpec", + "x-since-version": "v1.0.0" + }, + "postgres_database": { + "$ref": "#/$defs/string", + "x-since-version": "v1.0.0" + }, + "primary_key_columns": { + "$ref": "#/$defs/slice/string", + "x-since-version": "v1.0.0" + }, + "scheduling_policy": { + "$ref": "#/$defs/github.com/databricks/databricks-sdk-go/service/postgres.SyncedTableSyncedTableSpecSyncedTableSchedulingPolicy", + "x-since-version": "v1.0.0" + }, + "source_table_full_name": { + "$ref": "#/$defs/string", + "x-since-version": "v1.0.0" + }, + "synced_table_id": { + "$ref": "#/$defs/string", + "x-since-version": "v1.0.0" + }, + "timeseries_key": { + "$ref": "#/$defs/string", + "x-since-version": "v1.0.0" + } + }, + "additionalProperties": false, + "required": [ + "synced_table_id" + ] + }, "resources.QualityMonitor": { "type": "object", "properties": { @@ -2514,7 +2584,8 @@ }, "postgres_catalogs": { "description": "The Postgres catalog definitions for the bundle, where each key is the name of the catalog. Each entry binds a Unity Catalog catalog to a Postgres database on a Lakebase Autoscaling branch.", - "$ref": "#/$defs/map/github.com/databricks/cli/bundle/config/resources.PostgresCatalog" + "$ref": "#/$defs/map/github.com/databricks/cli/bundle/config/resources.PostgresCatalog", + "x-since-version": "v1.0.0" }, "postgres_endpoints": { "$ref": "#/$defs/map/github.com/databricks/cli/bundle/config/resources.PostgresEndpoint", @@ -2524,6 +2595,11 @@ "$ref": "#/$defs/map/github.com/databricks/cli/bundle/config/resources.PostgresProject", "x-since-version": "v0.287.0" }, + "postgres_synced_tables": { + "description": "The Postgres synced table definitions for the bundle, where each key is the name of the synced table. Each entry continuously replicates a Unity Catalog Delta source table into a Postgres table on a Lakebase Autoscaling instance.", + "$ref": "#/$defs/map/github.com/databricks/cli/bundle/config/resources.PostgresSyncedTable", + "x-since-version": "v1.0.0" + }, "quality_monitors": { "description": "The quality monitor definitions for the bundle, where each key is the name of the quality monitor.", "$ref": "#/$defs/map/github.com/databricks/cli/bundle/config/resources.QualityMonitor", @@ -3756,7 +3832,9 @@ "READ_METADATA", "MANAGE_ACCESS", "MANAGE_ACCESS_CONTROL", - "CREATE_SERVICE" + "CREATE_SERVICE", + "CREATE_FEATURE", + "READ_FEATURE" ] }, "catalog.PrivilegeAssignment": { @@ -4198,7 +4276,7 @@ }, "compute.DataSecurityMode": { "type": "string", - "description": "Data security mode decides what data governance model to use when accessing data\nfrom a cluster.\n\nThe following modes can only be used when `kind = CLASSIC_PREVIEW`.\n* `DATA_SECURITY_MODE_AUTO`: Databricks will choose the most appropriate access mode depending on your compute configuration.\n* `DATA_SECURITY_MODE_STANDARD`: Alias for `USER_ISOLATION`.\n* `DATA_SECURITY_MODE_DEDICATED`: Alias for `SINGLE_USER`.\n\nThe following modes can be used regardless of `kind`.\n* `NONE`: No security isolation for multiple users sharing the cluster. Data governance features are not available in this mode.\n* `SINGLE_USER`: A secure cluster that can only be exclusively used by a single user specified in `single_user_name`. Most programming languages, cluster features and data governance features are available in this mode.\n* `USER_ISOLATION`: A secure cluster that can be shared by multiple users. Cluster users are fully isolated so that they cannot see each other's data and credentials. Most data governance features are supported in this mode. But programming languages and cluster features might be limited.\n\nThe following modes are deprecated starting with Databricks Runtime 15.0 and\nwill be removed for future Databricks Runtime versions:\n\n* `LEGACY_TABLE_ACL`: This mode is for users migrating from legacy Table ACL clusters.\n* `LEGACY_PASSTHROUGH`: This mode is for users migrating from legacy Passthrough on high concurrency clusters.\n* `LEGACY_SINGLE_USER`: This mode is for users migrating from legacy Passthrough on standard clusters.\n* `LEGACY_SINGLE_USER_STANDARD`: This mode provides a way that doesn’t have UC nor passthrough enabled.", + "description": "Data security mode decides what data governance model to use when accessing data\nfrom a cluster.\n\n* `DATA_SECURITY_MODE_AUTO`: Databricks will choose the most appropriate access mode depending on your compute configuration.\n* `DATA_SECURITY_MODE_STANDARD`: A secure cluster that can be shared by multiple users. Cluster users are fully isolated so that they cannot see each other’s data and credentials. Most data governance features are supported in this mode. But programming languages and cluster features might be limited.\n* `DATA_SECURITY_MODE_DEDICATED`: A secure cluster that can only be exclusively used by a single user specified in `single_user_name`. Most programming languages, cluster features and data governance features are available in this mode.\n\nThe following modes are legacy aliases for the above modes:\n\n* `USER_ISOLATION`: Legacy alias for `DATA_SECURITY_MODE_STANDARD`.\n* `SINGLE_USER`: Legacy alias for `DATA_SECURITY_MODE_DEDICATED`.\n\nThe following modes are deprecated starting with Databricks Runtime 15.0 and\nwill be removed for future Databricks Runtime versions:\n\n* `LEGACY_TABLE_ACL`: This mode is for users migrating from legacy Table ACL clusters.\n* `LEGACY_PASSTHROUGH`: This mode is for users migrating from legacy Passthrough on high concurrency clusters.\n* `LEGACY_SINGLE_USER`: This mode is for users migrating from legacy Passthrough on standard clusters.\n* `LEGACY_SINGLE_USER_STANDARD`: This mode provides a way that doesn’t have UC nor passthrough enabled.", "enum": [ "NONE", "SINGLE_USER", @@ -4271,7 +4349,7 @@ "description": "The environment entity used to preserve serverless environment side panel, jobs' environment for non-notebook task, and SDP's environment for classic and serverless pipelines.\nIn this minimal environment spec, only pip and java dependencies are supported.", "properties": { "base_environment": { - "description": "The base environment this environment is built on top of. A base environment defines the environment version and a\nlist of dependencies for serverless compute. The value can be a file path to a custom `env.yaml` file\n(e.g., `/Workspace/path/to/env.yaml`). Support for a Databricks-provided base environment ID\n(e.g., `workspace-base-environments/databricks_ai_v4`) and workspace base environment ID\n(e.g., `workspace-base-environments/dbe_b849b66e-b31a-4cb5-b161-1f2b10877fb7`) is in Beta.\nEither `environment_version` or `base_environment` can be provided. For more information, see", + "description": "The base environment this environment is built on top of. A base environment defines the environment version and a\nlist of dependencies for serverless compute. The value can be a file path to a custom `env.yaml` file\n(e.g., `/Workspace/path/to/env.yaml`). Support for a Databricks-provided base environment ID\n(e.g., `workspace-base-environments/databricks_ai_v4`) and workspace base environment ID\n(e.g., `workspace-base-environments/dbe_b849b66e-b31a-4cb5-b161-1f2b10877fb7`) is in Beta.\nEither `environment_version` or `base_environment` can be provided.\nFor more information about Databricks-provided base environments, see the\n[list workspace base environments](:method:Environments/ListWorkspaceBaseEnvironments) API.\nFor more information, see", "$ref": "#/$defs/string", "x-since-version": "v0.289.0" }, @@ -4731,7 +4809,7 @@ "STOPPED", "UPDATING", "FAILING_OVER", - "MIGRATING" + "UPGRADING" ] }, "database.DeltaTableSyncInfo": { @@ -5792,6 +5870,22 @@ "description": "If true, triggers a full refresh on the spark declarative pipeline.", "$ref": "#/$defs/bool", "x-since-version": "v0.229.0" + }, + "full_refresh_selection": { + "description": "A list of tables to update with fullRefresh.", + "$ref": "#/$defs/slice/string" + }, + "refresh_flow_selection": { + "description": "Flow names to selectively refresh. These are unioned with other selective refresh\noptions (refresh_selection, full_refresh_selection) to determine the final set of flows to refresh.", + "$ref": "#/$defs/slice/string" + }, + "refresh_selection": { + "description": "A list of tables to update without fullRefresh.", + "$ref": "#/$defs/slice/string" + }, + "reset_checkpoint_selection": { + "description": "A list of streaming flows to reset checkpoints without clearing data.", + "$ref": "#/$defs/slice/string" } }, "additionalProperties": false @@ -5804,10 +5898,26 @@ "$ref": "#/$defs/bool", "x-since-version": "v0.229.0" }, + "full_refresh_selection": { + "description": "A list of tables to update with fullRefresh.", + "$ref": "#/$defs/slice/string" + }, "pipeline_id": { "description": "The full name of the pipeline task to execute.", "$ref": "#/$defs/string", "x-since-version": "v0.229.0" + }, + "refresh_flow_selection": { + "description": "Flow names to selectively refresh. These are unioned with other selective refresh\noptions (refresh_selection, full_refresh_selection) to determine the final set of flows to refresh.", + "$ref": "#/$defs/slice/string" + }, + "refresh_selection": { + "description": "A list of tables to update without fullRefresh.", + "$ref": "#/$defs/slice/string" + }, + "reset_checkpoint_selection": { + "description": "A list of streaming flows to reset checkpoints without clearing data.", + "$ref": "#/$defs/slice/string" } }, "additionalProperties": false, @@ -5903,6 +6013,32 @@ }, "additionalProperties": false }, + "jobs.PythonOperatorTask": { + "type": "object", + "properties": { + "main": { + "description": "Fully qualified name of the main class or function.\nFor example, `my_project.my_function` or `my_project.MyOperator`.", + "$ref": "#/$defs/string" + }, + "parameters": { + "description": "An ordered list of task parameters.\nTODO(JOBS-30885): Add limits for parameters.", + "$ref": "#/$defs/slice/github.com/databricks/databricks-sdk-go/service/jobs.PythonOperatorTaskParameter" + } + }, + "additionalProperties": false + }, + "jobs.PythonOperatorTaskParameter": { + "type": "object", + "properties": { + "name": { + "$ref": "#/$defs/string" + }, + "value": { + "$ref": "#/$defs/string" + } + }, + "additionalProperties": false + }, "jobs.PythonWheelTask": { "type": "object", "properties": { @@ -6407,8 +6543,6 @@ "disabled": { "description": "An optional flag to disable the task. If set to true, the task will not run even if it is part of a job.", "$ref": "#/$defs/bool", - "x-databricks-preview": "PRIVATE", - "doNotSuggest": true, "x-since-version": "v0.271.0" }, "email_notifications": { @@ -6486,6 +6620,12 @@ "$ref": "#/$defs/github.com/databricks/databricks-sdk-go/service/jobs.PowerBiTask", "x-since-version": "v0.248.0" }, + "python_operator_task": { + "description": "The task runs a Python operator task.", + "$ref": "#/$defs/github.com/databricks/databricks-sdk-go/service/jobs.PythonOperatorTask", + "x-databricks-preview": "PRIVATE", + "doNotSuggest": true + }, "python_wheel_task": { "description": "The task runs a Python wheel when the `python_wheel_task` field is present.", "$ref": "#/$defs/github.com/databricks/databricks-sdk-go/service/jobs.PythonWheelTask", @@ -6836,6 +6976,11 @@ "$ref": "#/$defs/github.com/databricks/databricks-sdk-go/service/pipelines.JiraConnectorOptions", "x-since-version": "v0.299.2" }, + "kafka_options": { + "$ref": "#/$defs/github.com/databricks/databricks-sdk-go/service/pipelines.KafkaOptions", + "x-databricks-preview": "PRIVATE", + "doNotSuggest": true + }, "meta_ads_options": { "description": "Meta Marketing (Meta Ads) specific options for ingestion", "$ref": "#/$defs/github.com/databricks/databricks-sdk-go/service/pipelines.MetaMarketingOptions", @@ -7055,7 +7200,8 @@ "EXCEL", "PARQUET", "AVRO", - "ORC" + "ORC", + "FILE" ] }, "pipelines.FileIngestionOptionsSchemaEvolutionMode": { @@ -7156,7 +7302,9 @@ "enum": [ "FILE", "FILE_METADATA", - "PERMISSION" + "PERMISSION", + "FILE_PERMISSION", + "GROUP_MEMBERSHIP" ] }, "pipelines.IngestionConfig": { @@ -7467,6 +7615,70 @@ }, "additionalProperties": false }, + "pipelines.JsonTransformerOptions": { + "type": "object", + "properties": { + "as_variant": { + "description": "Parse the entire value as a single Variant column.", + "$ref": "#/$defs/bool" + }, + "schema": { + "description": "Inline schema string for JSON parsing (Spark DDL format).", + "$ref": "#/$defs/string" + }, + "schema_evolution_mode": { + "description": "(Optional) Schema evolution mode for schema inference.", + "$ref": "#/$defs/github.com/databricks/databricks-sdk-go/service/pipelines.FileIngestionOptionsSchemaEvolutionMode" + }, + "schema_file_path": { + "description": "Path to a schema file (.ddl).", + "$ref": "#/$defs/string" + }, + "schema_hints": { + "description": "(Optional) Schema hints as a comma-separated string of \"column_name type\" pairs.", + "$ref": "#/$defs/string" + } + }, + "additionalProperties": false + }, + "pipelines.KafkaOptions": { + "type": "object", + "properties": { + "client_config": { + "description": "Undocumented backdoor mechanism for overriding parameters\nto pass to the Kafka client.\nThis is not supported and may break at any time.", + "$ref": "#/$defs/map/string", + "x-databricks-preview": "PRIVATE", + "doNotSuggest": true + }, + "key_transformer": { + "description": "(Optional) Transformer for the message key.\nIf not specified, the key is left as raw bytes.", + "$ref": "#/$defs/github.com/databricks/databricks-sdk-go/service/pipelines.Transformer" + }, + "max_offsets_per_trigger": { + "description": "Internal option to control the maximum number of offsets to process per trigger.", + "$ref": "#/$defs/int64", + "x-databricks-preview": "PRIVATE", + "doNotSuggest": true + }, + "starting_offset": { + "description": "(Optional) Where to begin reading when no checkpoint exists.\nValid values: \"latest\" and \"earliest\". Defaults to \"latest\".", + "$ref": "#/$defs/string" + }, + "topic_pattern": { + "description": "Java regex pattern to subscribe to matching topics.\nOnly one of topics or topic_pattern must be specified.", + "$ref": "#/$defs/string" + }, + "topics": { + "description": "Topics to subscribe to.\nOnly one of topics or topic_pattern must be specified.", + "$ref": "#/$defs/slice/string" + }, + "value_transformer": { + "description": "(Optional) Transformer for the message value.\nIf not specified, the value is left as raw bytes.", + "$ref": "#/$defs/github.com/databricks/databricks-sdk-go/service/pipelines.Transformer" + } + }, + "additionalProperties": false + }, "pipelines.ManualTrigger": { "type": "object", "additionalProperties": false @@ -8074,7 +8286,9 @@ "FILE", "FILE_METADATA", "PERMISSION", - "LIST" + "LIST", + "FILE_PERMISSION", + "GROUP_MEMBERSHIP" ] }, "pipelines.SmartsheetOptions": { @@ -8306,6 +8520,29 @@ "GMV_MAX" ] }, + "pipelines.Transformer": { + "type": "object", + "description": "Specifies how to transform binary data into structured data.", + "properties": { + "format": { + "description": "Required: the wire format of the data.", + "$ref": "#/$defs/github.com/databricks/databricks-sdk-go/service/pipelines.TransformerFormat" + }, + "json_options": { + "$ref": "#/$defs/github.com/databricks/databricks-sdk-go/service/pipelines.JsonTransformerOptions" + } + }, + "additionalProperties": false + }, + "pipelines.TransformerFormat": { + "type": "string", + "enum": [ + "STRING", + "JSON", + "AVRO", + "PROTOBUF" + ] + }, "pipelines.ZendeskSupportOptions": { "type": "object", "description": "Zendesk Support specific options for ingestion", @@ -8363,6 +8600,27 @@ "ENDPOINT_TYPE_READ_ONLY" ] }, + "postgres.NewPipelineSpec": { + "type": "object", + "properties": { + "budget_policy_id": { + "description": "Budget policy to set on the newly created pipeline.", + "$ref": "#/$defs/string", + "x-since-version": "v1.0.0" + }, + "storage_catalog": { + "description": "UC catalog for the pipeline to store intermediate files (checkpoints, event logs etc).\nThis needs to be a standard catalog where the user has permissions to create Delta tables.", + "$ref": "#/$defs/string", + "x-since-version": "v1.0.0" + }, + "storage_schema": { + "description": "UC schema for the pipeline to store intermediate files (checkpoints, event logs etc).\nThis needs to be in the standard catalog where the user has permissions to create Delta tables.", + "$ref": "#/$defs/string", + "x-since-version": "v1.0.0" + } + }, + "additionalProperties": false + }, "postgres.ProjectCustomTag": { "type": "object", "properties": { @@ -8411,6 +8669,15 @@ }, "additionalProperties": false }, + "postgres.SyncedTableSyncedTableSpecSyncedTableSchedulingPolicy": { + "type": "string", + "description": "Scheduling policy of the synced table's underlying pipeline.", + "enum": [ + "CONTINUOUS", + "TRIGGERED", + "SNAPSHOT" + ] + }, "serving.Ai21LabsConfig": { "type": "object", "properties": { @@ -9314,7 +9581,8 @@ "GPU_MEDIUM", "GPU_SMALL", "GPU_LARGE", - "MULTIGPU_MEDIUM" + "MULTIGPU_MEDIUM", + "GPU_XLARGE" ] }, "serving.ServingEndpointPermissionLevel": { @@ -9334,7 +9602,8 @@ "GPU_MEDIUM", "GPU_SMALL", "GPU_LARGE", - "MULTIGPU_MEDIUM" + "MULTIGPU_MEDIUM", + "GPU_XLARGE" ] }, "serving.TrafficConfig": { @@ -9795,6 +10064,12 @@ "$ref": "#/$defs/github.com/databricks/cli/bundle/config/resources.PostgresProject" } }, + "resources.PostgresSyncedTable": { + "type": "object", + "additionalProperties": { + "$ref": "#/$defs/github.com/databricks/cli/bundle/config/resources.PostgresSyncedTable" + } + }, "resources.QualityMonitor": { "type": "object", "additionalProperties": { @@ -10076,6 +10351,12 @@ "$ref": "#/$defs/github.com/databricks/databricks-sdk-go/service/jobs.PowerBiTable" } }, + "jobs.PythonOperatorTaskParameter": { + "type": "array", + "items": { + "$ref": "#/$defs/github.com/databricks/databricks-sdk-go/service/jobs.PythonOperatorTaskParameter" + } + }, "jobs.SqlTaskSubscription": { "type": "array", "items": { diff --git a/cmd/account/endpoints/endpoints.go b/cmd/account/endpoints/endpoints.go index 0da1a198d02..eb3056de47f 100755 --- a/cmd/account/endpoints/endpoints.go +++ b/cmd/account/endpoints/endpoints.go @@ -20,8 +20,8 @@ var cmdOverrides []func(*cobra.Command) func New() *cobra.Command { cmd := &cobra.Command{ Use: "endpoints", - Short: `*Beta* These APIs manage endpoint configurations for this account.`, - Long: `This command is in Beta and may change without notice. + Short: `*Public Preview* These APIs manage endpoint configurations for this account.`, + Long: `This command is in Public Preview and may change without notice. These APIs manage endpoint configurations for this account.`, GroupID: "provisioning", @@ -29,8 +29,8 @@ These APIs manage endpoint configurations for this account.`, } cmd.Annotations = make(map[string]string) - cmd.Annotations["launch_stage"] = "PUBLIC_BETA" - cmd.Annotations["launch_stage_display"] = "Beta" + cmd.Annotations["launch_stage"] = "PUBLIC_PREVIEW" + cmd.Annotations["launch_stage_display"] = "Public Preview" // Add methods cmd.AddCommand(newCreateEndpoint()) @@ -67,8 +67,8 @@ func newCreateEndpoint() *cobra.Command { // TODO: complex arg: azure_private_endpoint_info cmd.Use = "create-endpoint PARENT DISPLAY_NAME REGION" - cmd.Short = `*Beta* Create a network endpoint.` - cmd.Long = `This command is in Beta and may change without notice. + cmd.Short = `*Public Preview* Create a network endpoint.` + cmd.Long = `This command is in Public Preview and may change without notice. Create a network endpoint. @@ -91,8 +91,8 @@ Create a network endpoint. REGION: The cloud provider region where this endpoint is located.` cmd.Annotations = make(map[string]string) - cmd.Annotations["launch_stage"] = "PUBLIC_BETA" - cmd.Annotations["launch_stage_display"] = "Beta" + cmd.Annotations["launch_stage"] = "PUBLIC_PREVIEW" + cmd.Annotations["launch_stage_display"] = "Public Preview" cmd.Args = func(cmd *cobra.Command, args []string) error { if cmd.Flags().Changed("json") { @@ -166,8 +166,8 @@ func newDeleteEndpoint() *cobra.Command { var deleteEndpointReq networking.DeleteEndpointRequest cmd.Use = "delete-endpoint NAME" - cmd.Short = `*Beta* Delete a network endpoint.` - cmd.Long = `This command is in Beta and may change without notice. + cmd.Short = `*Public Preview* Delete a network endpoint.` + cmd.Long = `This command is in Public Preview and may change without notice. Delete a network endpoint. @@ -176,8 +176,8 @@ Delete a network endpoint. delete corresponding network resources in your cloud provider account.` cmd.Annotations = make(map[string]string) - cmd.Annotations["launch_stage"] = "PUBLIC_BETA" - cmd.Annotations["launch_stage_display"] = "Beta" + cmd.Annotations["launch_stage"] = "PUBLIC_PREVIEW" + cmd.Annotations["launch_stage_display"] = "Public Preview" cmd.Args = func(cmd *cobra.Command, args []string) error { check := root.ExactArgs(1) @@ -225,16 +225,16 @@ func newGetEndpoint() *cobra.Command { var getEndpointReq networking.GetEndpointRequest cmd.Use = "get-endpoint NAME" - cmd.Short = `*Beta* Get a network endpoint.` - cmd.Long = `This command is in Beta and may change without notice. + cmd.Short = `*Public Preview* Get a network endpoint.` + cmd.Long = `This command is in Public Preview and may change without notice. Get a network endpoint. Gets details of a specific network endpoint.` cmd.Annotations = make(map[string]string) - cmd.Annotations["launch_stage"] = "PUBLIC_BETA" - cmd.Annotations["launch_stage_display"] = "Beta" + cmd.Annotations["launch_stage"] = "PUBLIC_PREVIEW" + cmd.Annotations["launch_stage_display"] = "Public Preview" cmd.Args = func(cmd *cobra.Command, args []string) error { check := root.ExactArgs(1) @@ -296,8 +296,8 @@ func newListEndpoints() *cobra.Command { cmd.Flags().Lookup("page-token").Hidden = true cmd.Use = "list-endpoints PARENT" - cmd.Short = `*Beta* List network endpoints.` - cmd.Long = `This command is in Beta and may change without notice. + cmd.Short = `*Public Preview* List network endpoints.` + cmd.Long = `This command is in Public Preview and may change without notice. List network endpoints. @@ -308,8 +308,8 @@ List network endpoints. accounts/{account_id}.` cmd.Annotations = make(map[string]string) - cmd.Annotations["launch_stage"] = "PUBLIC_BETA" - cmd.Annotations["launch_stage_display"] = "Beta" + cmd.Annotations["launch_stage"] = "PUBLIC_PREVIEW" + cmd.Annotations["launch_stage_display"] = "Public Preview" cmd.Args = func(cmd *cobra.Command, args []string) error { check := root.ExactArgs(1) diff --git a/cmd/account/iam-v2/iam-v2.go b/cmd/account/iam-v2/iam-v2.go index bbddb8cbca4..965966c124c 100755 --- a/cmd/account/iam-v2/iam-v2.go +++ b/cmd/account/iam-v2/iam-v2.go @@ -4,11 +4,13 @@ package iam_v2 import ( "fmt" + "strings" "github.com/databricks/cli/cmd/root" "github.com/databricks/cli/libs/cmdctx" "github.com/databricks/cli/libs/cmdio" "github.com/databricks/cli/libs/flags" + "github.com/databricks/databricks-sdk-go/common/types/fieldmask" "github.com/databricks/databricks-sdk-go/service/iamv2" "github.com/spf13/cobra" ) @@ -34,10 +36,15 @@ These APIs are used to manage identities and the workspace access of these cmd.Annotations["launch_stage_display"] = "Beta" // Add methods + cmd.AddCommand(newCreateWorkspaceAssignmentDetail()) + cmd.AddCommand(newDeleteWorkspaceAssignmentDetail()) cmd.AddCommand(newGetWorkspaceAccessDetail()) + cmd.AddCommand(newGetWorkspaceAssignmentDetail()) + cmd.AddCommand(newListWorkspaceAssignmentDetails()) cmd.AddCommand(newResolveGroup()) cmd.AddCommand(newResolveServicePrincipal()) cmd.AddCommand(newResolveUser()) + cmd.AddCommand(newUpdateWorkspaceAssignmentDetail()) // Apply optional overrides to this command. for _, fn := range cmdOverrides { @@ -47,6 +54,185 @@ These APIs are used to manage identities and the workspace access of these return cmd } +// start create-workspace-assignment-detail command + +// Slice with functions to override default command behavior. +// Functions can be added from the `init()` function in manually curated files in this directory. +var createWorkspaceAssignmentDetailOverrides []func( + *cobra.Command, + *iamv2.CreateWorkspaceAssignmentDetailRequest, +) + +func newCreateWorkspaceAssignmentDetail() *cobra.Command { + cmd := &cobra.Command{} + + var createWorkspaceAssignmentDetailReq iamv2.CreateWorkspaceAssignmentDetailRequest + createWorkspaceAssignmentDetailReq.WorkspaceAssignmentDetail = iamv2.WorkspaceAssignmentDetail{} + var createWorkspaceAssignmentDetailJson flags.JsonFlag + + cmd.Flags().Var(&createWorkspaceAssignmentDetailJson, "json", `either inline JSON string or @path/to/file.json with request body`) + + // TODO: array: entitlements + + cmd.Use = "create-workspace-assignment-detail WORKSPACE_ID PRINCIPAL_ID" + cmd.Short = `Create a workspace assignment detail.` + cmd.Long = `Create a workspace assignment detail. + + Creates a workspace assignment detail for a principal. Entitlement grants are + applied individually and non-atomically — if a failure occurs partway + through, the principal will be assigned to the workspace but with only a + subset of the requested entitlements. Use GetWorkspaceAssignmentDetail to + confirm which entitlements were successfully granted. + + Arguments: + WORKSPACE_ID: Required. The workspace ID for which the workspace assignment detail is + being created. + PRINCIPAL_ID: The internal ID of the principal (user/sp/group) in Databricks.` + + // This command is being previewed; hide from help output. + cmd.Hidden = true + + cmd.Annotations = make(map[string]string) + cmd.Annotations["launch_stage"] = "PRIVATE_PREVIEW" + cmd.Annotations["launch_stage_display"] = "Private Preview" + + cmd.Args = func(cmd *cobra.Command, args []string) error { + if cmd.Flags().Changed("json") { + err := root.ExactArgs(1)(cmd, args) + if err != nil { + return fmt.Errorf("when --json flag is specified, provide only WORKSPACE_ID as positional arguments. Provide 'principal_id' in your JSON input") + } + return nil + } + check := root.ExactArgs(2) + return check(cmd, args) + } + + cmd.PreRunE = root.MustAccountClient + cmd.RunE = func(cmd *cobra.Command, args []string) (err error) { + ctx := cmd.Context() + a := cmdctx.AccountClient(ctx) + + if cmd.Flags().Changed("json") { + diags := createWorkspaceAssignmentDetailJson.Unmarshal(&createWorkspaceAssignmentDetailReq.WorkspaceAssignmentDetail) + if diags.HasError() { + return diags.Error() + } + if len(diags) > 0 { + err := cmdio.RenderDiagnostics(ctx, diags) + if err != nil { + return err + } + } + } + _, err = fmt.Sscan(args[0], &createWorkspaceAssignmentDetailReq.WorkspaceId) + if err != nil { + return fmt.Errorf("invalid WORKSPACE_ID: %s", args[0]) + } + + if !cmd.Flags().Changed("json") { + _, err = fmt.Sscan(args[1], &createWorkspaceAssignmentDetailReq.WorkspaceAssignmentDetail.PrincipalId) + if err != nil { + return fmt.Errorf("invalid PRINCIPAL_ID: %s", args[1]) + } + + } + + response, err := a.IamV2.CreateWorkspaceAssignmentDetail(ctx, createWorkspaceAssignmentDetailReq) + if err != nil { + return err + } + + return cmdio.Render(ctx, response) + } + + // Disable completions since they are not applicable. + // Can be overridden by manual implementation in `override.go`. + cmd.ValidArgsFunction = cobra.NoFileCompletions + + // Apply optional overrides to this command. + for _, fn := range createWorkspaceAssignmentDetailOverrides { + fn(cmd, &createWorkspaceAssignmentDetailReq) + } + + return cmd +} + +// start delete-workspace-assignment-detail command + +// Slice with functions to override default command behavior. +// Functions can be added from the `init()` function in manually curated files in this directory. +var deleteWorkspaceAssignmentDetailOverrides []func( + *cobra.Command, + *iamv2.DeleteWorkspaceAssignmentDetailRequest, +) + +func newDeleteWorkspaceAssignmentDetail() *cobra.Command { + cmd := &cobra.Command{} + + var deleteWorkspaceAssignmentDetailReq iamv2.DeleteWorkspaceAssignmentDetailRequest + + cmd.Use = "delete-workspace-assignment-detail WORKSPACE_ID PRINCIPAL_ID" + cmd.Short = `Delete a workspace assignment detail.` + cmd.Long = `Delete a workspace assignment detail. + + Deletes a workspace assignment detail for a principal, revoking all associated + entitlements. Entitlement revocations are applied individually and + non-atomically — if a failure occurs partway through, the principal remains + assigned with a subset of its original entitlements, and the operation is safe + to retry. + + Arguments: + WORKSPACE_ID: The workspace ID where the principal has access. + PRINCIPAL_ID: Required. ID of the principal in Databricks to delete workspace assignment + for.` + + // This command is being previewed; hide from help output. + cmd.Hidden = true + + cmd.Annotations = make(map[string]string) + cmd.Annotations["launch_stage"] = "PRIVATE_PREVIEW" + cmd.Annotations["launch_stage_display"] = "Private Preview" + + cmd.Args = func(cmd *cobra.Command, args []string) error { + check := root.ExactArgs(2) + return check(cmd, args) + } + + cmd.PreRunE = root.MustAccountClient + cmd.RunE = func(cmd *cobra.Command, args []string) (err error) { + ctx := cmd.Context() + a := cmdctx.AccountClient(ctx) + + _, err = fmt.Sscan(args[0], &deleteWorkspaceAssignmentDetailReq.WorkspaceId) + if err != nil { + return fmt.Errorf("invalid WORKSPACE_ID: %s", args[0]) + } + + _, err = fmt.Sscan(args[1], &deleteWorkspaceAssignmentDetailReq.PrincipalId) + if err != nil { + return fmt.Errorf("invalid PRINCIPAL_ID: %s", args[1]) + } + + err = a.IamV2.DeleteWorkspaceAssignmentDetail(ctx, deleteWorkspaceAssignmentDetailReq) + if err != nil { + return err + } + return nil + } + + // Disable completions since they are not applicable. + // Can be overridden by manual implementation in `override.go`. + cmd.ValidArgsFunction = cobra.NoFileCompletions + + // Apply optional overrides to this command. + for _, fn := range deleteWorkspaceAssignmentDetailOverrides { + fn(cmd, &deleteWorkspaceAssignmentDetailReq) + } + + return cmd +} + // start get-workspace-access-detail command // Slice with functions to override default command behavior. @@ -126,6 +312,148 @@ Get workspace access details for a principal. return cmd } +// start get-workspace-assignment-detail command + +// Slice with functions to override default command behavior. +// Functions can be added from the `init()` function in manually curated files in this directory. +var getWorkspaceAssignmentDetailOverrides []func( + *cobra.Command, + *iamv2.GetWorkspaceAssignmentDetailRequest, +) + +func newGetWorkspaceAssignmentDetail() *cobra.Command { + cmd := &cobra.Command{} + + var getWorkspaceAssignmentDetailReq iamv2.GetWorkspaceAssignmentDetailRequest + + cmd.Use = "get-workspace-assignment-detail WORKSPACE_ID PRINCIPAL_ID" + cmd.Short = `Get workspace assignment details for a principal.` + cmd.Long = `Get workspace assignment details for a principal. + + Returns the assignment details for a principal in a workspace. + + Arguments: + WORKSPACE_ID: Required. The workspace ID for which the assignment details are being + requested. + PRINCIPAL_ID: Required. The internal ID of the principal (user/sp/group) for which the + assignment details are being requested.` + + // This command is being previewed; hide from help output. + cmd.Hidden = true + + cmd.Annotations = make(map[string]string) + cmd.Annotations["launch_stage"] = "PRIVATE_PREVIEW" + cmd.Annotations["launch_stage_display"] = "Private Preview" + + cmd.Args = func(cmd *cobra.Command, args []string) error { + check := root.ExactArgs(2) + return check(cmd, args) + } + + cmd.PreRunE = root.MustAccountClient + cmd.RunE = func(cmd *cobra.Command, args []string) (err error) { + ctx := cmd.Context() + a := cmdctx.AccountClient(ctx) + + _, err = fmt.Sscan(args[0], &getWorkspaceAssignmentDetailReq.WorkspaceId) + if err != nil { + return fmt.Errorf("invalid WORKSPACE_ID: %s", args[0]) + } + + _, err = fmt.Sscan(args[1], &getWorkspaceAssignmentDetailReq.PrincipalId) + if err != nil { + return fmt.Errorf("invalid PRINCIPAL_ID: %s", args[1]) + } + + response, err := a.IamV2.GetWorkspaceAssignmentDetail(ctx, getWorkspaceAssignmentDetailReq) + if err != nil { + return err + } + + return cmdio.Render(ctx, response) + } + + // Disable completions since they are not applicable. + // Can be overridden by manual implementation in `override.go`. + cmd.ValidArgsFunction = cobra.NoFileCompletions + + // Apply optional overrides to this command. + for _, fn := range getWorkspaceAssignmentDetailOverrides { + fn(cmd, &getWorkspaceAssignmentDetailReq) + } + + return cmd +} + +// start list-workspace-assignment-details command + +// Slice with functions to override default command behavior. +// Functions can be added from the `init()` function in manually curated files in this directory. +var listWorkspaceAssignmentDetailsOverrides []func( + *cobra.Command, + *iamv2.ListWorkspaceAssignmentDetailsRequest, +) + +func newListWorkspaceAssignmentDetails() *cobra.Command { + cmd := &cobra.Command{} + + var listWorkspaceAssignmentDetailsReq iamv2.ListWorkspaceAssignmentDetailsRequest + + cmd.Flags().IntVar(&listWorkspaceAssignmentDetailsReq.PageSize, "page-size", listWorkspaceAssignmentDetailsReq.PageSize, `The maximum number of workspace assignment details to return.`) + cmd.Flags().StringVar(&listWorkspaceAssignmentDetailsReq.PageToken, "page-token", listWorkspaceAssignmentDetailsReq.PageToken, `A page token, received from a previous ListWorkspaceAssignmentDetails call.`) + + cmd.Use = "list-workspace-assignment-details WORKSPACE_ID" + cmd.Short = `List workspace assignment details for a workspace.` + cmd.Long = `List workspace assignment details for a workspace. + + Lists workspace assignment details for a workspace. + + Arguments: + WORKSPACE_ID: Required. The workspace ID for which the workspace assignment details are + being fetched.` + + // This command is being previewed; hide from help output. + cmd.Hidden = true + + cmd.Annotations = make(map[string]string) + cmd.Annotations["launch_stage"] = "PRIVATE_PREVIEW" + cmd.Annotations["launch_stage_display"] = "Private Preview" + + cmd.Args = func(cmd *cobra.Command, args []string) error { + check := root.ExactArgs(1) + return check(cmd, args) + } + + cmd.PreRunE = root.MustAccountClient + cmd.RunE = func(cmd *cobra.Command, args []string) (err error) { + ctx := cmd.Context() + a := cmdctx.AccountClient(ctx) + + _, err = fmt.Sscan(args[0], &listWorkspaceAssignmentDetailsReq.WorkspaceId) + if err != nil { + return fmt.Errorf("invalid WORKSPACE_ID: %s", args[0]) + } + + response, err := a.IamV2.ListWorkspaceAssignmentDetails(ctx, listWorkspaceAssignmentDetailsReq) + if err != nil { + return err + } + + return cmdio.Render(ctx, response) + } + + // Disable completions since they are not applicable. + // Can be overridden by manual implementation in `override.go`. + cmd.ValidArgsFunction = cobra.NoFileCompletions + + // Apply optional overrides to this command. + for _, fn := range listWorkspaceAssignmentDetailsOverrides { + fn(cmd, &listWorkspaceAssignmentDetailsReq) + } + + return cmd +} + // start resolve-group command // Slice with functions to override default command behavior. @@ -388,4 +716,119 @@ Resolve an external user in the Databricks account. return cmd } +// start update-workspace-assignment-detail command + +// Slice with functions to override default command behavior. +// Functions can be added from the `init()` function in manually curated files in this directory. +var updateWorkspaceAssignmentDetailOverrides []func( + *cobra.Command, + *iamv2.UpdateWorkspaceAssignmentDetailRequest, +) + +func newUpdateWorkspaceAssignmentDetail() *cobra.Command { + cmd := &cobra.Command{} + + var updateWorkspaceAssignmentDetailReq iamv2.UpdateWorkspaceAssignmentDetailRequest + updateWorkspaceAssignmentDetailReq.WorkspaceAssignmentDetail = iamv2.WorkspaceAssignmentDetail{} + var updateWorkspaceAssignmentDetailJson flags.JsonFlag + + cmd.Flags().Var(&updateWorkspaceAssignmentDetailJson, "json", `either inline JSON string or @path/to/file.json with request body`) + + // TODO: array: entitlements + + cmd.Use = "update-workspace-assignment-detail WORKSPACE_ID PRINCIPAL_ID UPDATE_MASK PRINCIPAL_ID" + cmd.Short = `Update a workspace assignment detail.` + cmd.Long = `Update a workspace assignment detail. + + Updates the entitlements of a directly assigned principal in a workspace. + Entitlement changes are applied individually and non-atomically — if a + failure occurs partway through, only a subset of the requested changes may + have been applied. Use GetWorkspaceAssignmentDetail to confirm the final + state. + + Arguments: + WORKSPACE_ID: Required. The workspace ID for which the workspace assignment detail is + being updated. + PRINCIPAL_ID: Required. ID of the principal in Databricks. + UPDATE_MASK: Required. The list of fields to update. + PRINCIPAL_ID: The internal ID of the principal (user/sp/group) in Databricks.` + + // This command is being previewed; hide from help output. + cmd.Hidden = true + + cmd.Annotations = make(map[string]string) + cmd.Annotations["launch_stage"] = "PRIVATE_PREVIEW" + cmd.Annotations["launch_stage_display"] = "Private Preview" + + cmd.Args = func(cmd *cobra.Command, args []string) error { + if cmd.Flags().Changed("json") { + err := root.ExactArgs(3)(cmd, args) + if err != nil { + return fmt.Errorf("when --json flag is specified, provide only WORKSPACE_ID, PRINCIPAL_ID, UPDATE_MASK as positional arguments. Provide 'principal_id' in your JSON input") + } + return nil + } + check := root.ExactArgs(4) + return check(cmd, args) + } + + cmd.PreRunE = root.MustAccountClient + cmd.RunE = func(cmd *cobra.Command, args []string) (err error) { + ctx := cmd.Context() + a := cmdctx.AccountClient(ctx) + + if cmd.Flags().Changed("json") { + diags := updateWorkspaceAssignmentDetailJson.Unmarshal(&updateWorkspaceAssignmentDetailReq.WorkspaceAssignmentDetail) + if diags.HasError() { + return diags.Error() + } + if len(diags) > 0 { + err := cmdio.RenderDiagnostics(ctx, diags) + if err != nil { + return err + } + } + } + _, err = fmt.Sscan(args[0], &updateWorkspaceAssignmentDetailReq.WorkspaceId) + if err != nil { + return fmt.Errorf("invalid WORKSPACE_ID: %s", args[0]) + } + + _, err = fmt.Sscan(args[1], &updateWorkspaceAssignmentDetailReq.PrincipalId) + if err != nil { + return fmt.Errorf("invalid PRINCIPAL_ID: %s", args[1]) + } + + if args[2] != "" { + updateMaskArray := strings.Split(args[2], ",") + updateWorkspaceAssignmentDetailReq.UpdateMask = *fieldmask.New(updateMaskArray) + } + if !cmd.Flags().Changed("json") { + _, err = fmt.Sscan(args[3], &updateWorkspaceAssignmentDetailReq.WorkspaceAssignmentDetail.PrincipalId) + if err != nil { + return fmt.Errorf("invalid PRINCIPAL_ID: %s", args[3]) + } + + } + + response, err := a.IamV2.UpdateWorkspaceAssignmentDetail(ctx, updateWorkspaceAssignmentDetailReq) + if err != nil { + return err + } + + return cmdio.Render(ctx, response) + } + + // Disable completions since they are not applicable. + // Can be overridden by manual implementation in `override.go`. + cmd.ValidArgsFunction = cobra.NoFileCompletions + + // Apply optional overrides to this command. + for _, fn := range updateWorkspaceAssignmentDetailOverrides { + fn(cmd, &updateWorkspaceAssignmentDetailReq) + } + + return cmd +} + // end service AccountIamV2 diff --git a/cmd/account/settings-v2/settings-v2.go b/cmd/account/settings-v2/settings-v2.go index 7e6a042e83a..c42665912dd 100755 --- a/cmd/account/settings-v2/settings-v2.go +++ b/cmd/account/settings-v2/settings-v2.go @@ -349,18 +349,22 @@ func newPatchPublicAccountSetting() *cobra.Command { // TODO: complex arg: aibi_dashboard_embedding_access_policy // TODO: complex arg: aibi_dashboard_embedding_approved_domains + // TODO: complex arg: allowed_apps_user_api_scopes // TODO: complex arg: automatic_cluster_update_workspace // TODO: complex arg: boolean_val // TODO: complex arg: effective_aibi_dashboard_embedding_access_policy // TODO: complex arg: effective_aibi_dashboard_embedding_approved_domains + // TODO: complex arg: effective_allowed_apps_user_api_scopes // TODO: complex arg: effective_automatic_cluster_update_workspace // TODO: complex arg: effective_boolean_val // TODO: complex arg: effective_integer_val + // TODO: complex arg: effective_operational_email_custom_recipient // TODO: complex arg: effective_personal_compute // TODO: complex arg: effective_restrict_workspace_admins // TODO: complex arg: effective_string_val // TODO: complex arg: integer_val cmd.Flags().StringVar(&patchPublicAccountSettingReq.Setting.Name, "name", patchPublicAccountSettingReq.Setting.Name, `Name of the setting.`) + // TODO: complex arg: operational_email_custom_recipient // TODO: complex arg: personal_compute // TODO: complex arg: restrict_workspace_admins // TODO: complex arg: string_val diff --git a/cmd/apps/import.go b/cmd/apps/import.go index 67cf4ae9d9e..42f9da4ec14 100644 --- a/cmd/apps/import.go +++ b/cmd/apps/import.go @@ -34,6 +34,7 @@ import ( "github.com/databricks/cli/libs/textutil" "github.com/databricks/databricks-sdk-go" "github.com/databricks/databricks-sdk-go/service/apps" + "github.com/databricks/databricks-sdk-go/service/iam" "github.com/databricks/databricks-sdk-go/service/workspace" "github.com/spf13/cobra" ) @@ -89,7 +90,7 @@ Examples: w := cmdctx.WorkspaceClient(ctx) // Get current user to filter apps - me, err := w.CurrentUser.Me(ctx) + me, err := w.CurrentUser.Me(ctx, iam.MeRequest{}) if err != nil { return fmt.Errorf("failed to get current user: %w", err) } diff --git a/cmd/apps/run_local.go b/cmd/apps/run_local.go index d4bc546ab7c..8d42783c47e 100644 --- a/cmd/apps/run_local.go +++ b/cmd/apps/run_local.go @@ -18,6 +18,7 @@ import ( "github.com/databricks/cli/libs/cmdctx" "github.com/databricks/cli/libs/cmdio" "github.com/databricks/databricks-sdk-go" + "github.com/databricks/databricks-sdk-go/service/iam" "github.com/spf13/cobra" ) @@ -116,7 +117,7 @@ func setupProxy(ctx context.Context, cmd *cobra.Command, config *runlocal.Config return err } - me, err := w.CurrentUser.Me(ctx) + me, err := w.CurrentUser.Me(ctx, iam.MeRequest{}) if err != nil { return err } diff --git a/cmd/auth/describe.go b/cmd/auth/describe.go index 56f10630de1..b4abe63d65d 100644 --- a/cmd/auth/describe.go +++ b/cmd/auth/describe.go @@ -14,6 +14,7 @@ import ( "github.com/databricks/cli/libs/flags" "github.com/databricks/cli/libs/log" "github.com/databricks/databricks-sdk-go/config" + "github.com/databricks/databricks-sdk-go/service/iam" "github.com/spf13/cobra" ) @@ -127,7 +128,7 @@ func getAuthStatus(cmd *cobra.Command, args []string, showSensitive bool, fn try } w := cmdctx.WorkspaceClient(ctx) - me, err := w.CurrentUser.Me(ctx) + me, err := w.CurrentUser.Me(ctx, iam.MeRequest{}) if err != nil { details := getAuthDetails(cmd, cfg, showSensitive) return &authStatus{ //nolint:nilerr // error is returned in the authStatus struct diff --git a/cmd/auth/describe_test.go b/cmd/auth/describe_test.go index 72fee3486bc..3fb26c06d93 100644 --- a/cmd/auth/describe_test.go +++ b/cmd/auth/describe_test.go @@ -27,7 +27,7 @@ func TestGetWorkspaceAuthStatus(t *testing.T) { showSensitive := false currentUserApi := m.GetMockCurrentUserAPI() - currentUserApi.EXPECT().Me(mock.Anything).Return(&iam.User{ + currentUserApi.EXPECT().Me(mock.Anything, mock.Anything).Return(&iam.User{ UserName: "test-user", }, nil) @@ -306,7 +306,7 @@ func TestGetWorkspaceAuthStatus_U2M_PopulatesTokenStorage(t *testing.T) { cmd.SetContext(ctx) currentUserApi := m.GetMockCurrentUserAPI() - currentUserApi.EXPECT().Me(mock.Anything).Return(&iam.User{UserName: "u2m-user"}, nil) + currentUserApi.EXPECT().Me(mock.Anything, mock.Anything).Return(&iam.User{UserName: "u2m-user"}, nil) cmd.Flags().String("host", "", "") cmd.Flags().String("profile", "", "") @@ -343,7 +343,7 @@ func TestGetWorkspaceAuthStatus_NonU2M_OmitsTokenStorage(t *testing.T) { cmd.SetContext(ctx) currentUserApi := m.GetMockCurrentUserAPI() - currentUserApi.EXPECT().Me(mock.Anything).Return(&iam.User{UserName: "pat-user"}, nil) + currentUserApi.EXPECT().Me(mock.Anything, mock.Anything).Return(&iam.User{UserName: "pat-user"}, nil) cmd.Flags().String("host", "", "") cmd.Flags().String("profile", "", "") diff --git a/cmd/auth/profiles.go b/cmd/auth/profiles.go index 51c397a9ea9..09d52d7da00 100644 --- a/cmd/auth/profiles.go +++ b/cmd/auth/profiles.go @@ -16,6 +16,7 @@ import ( "github.com/databricks/cli/libs/log" "github.com/databricks/databricks-sdk-go" "github.com/databricks/databricks-sdk-go/config" + "github.com/databricks/databricks-sdk-go/service/iam" "github.com/spf13/cobra" "gopkg.in/ini.v1" ) @@ -80,7 +81,7 @@ func (c *profileMetadata) Load(ctx context.Context, configFilePath string, skipV if err != nil { return } - _, err = w.CurrentUser.Me(ctx) + _, err = w.CurrentUser.Me(ctx, iam.MeRequest{}) c.Host = cfg.Host c.AuthType = cfg.AuthType if err != nil { diff --git a/cmd/psql/psql_autoscaling.go b/cmd/psql/psql_autoscaling.go index 00c555e4c12..331e05b55b5 100644 --- a/cmd/psql/psql_autoscaling.go +++ b/cmd/psql/psql_autoscaling.go @@ -10,6 +10,7 @@ import ( "github.com/databricks/cli/libs/cmdio" libpsql "github.com/databricks/cli/libs/psql" "github.com/databricks/databricks-sdk-go" + "github.com/databricks/databricks-sdk-go/service/iam" "github.com/databricks/databricks-sdk-go/service/postgres" ) @@ -37,7 +38,7 @@ func connectAutoscaling(ctx context.Context, projectID, branchID, endpointID str return err } - user, err := w.CurrentUser.Me(ctx) + user, err := w.CurrentUser.Me(ctx, iam.MeRequest{}) if err != nil { return fmt.Errorf("failed to get current user: %w", err) } diff --git a/cmd/psql/psql_provisioned.go b/cmd/psql/psql_provisioned.go index 88ca1bb9181..b66f17d1508 100644 --- a/cmd/psql/psql_provisioned.go +++ b/cmd/psql/psql_provisioned.go @@ -10,6 +10,7 @@ import ( libpsql "github.com/databricks/cli/libs/psql" "github.com/databricks/databricks-sdk-go" "github.com/databricks/databricks-sdk-go/service/database" + "github.com/databricks/databricks-sdk-go/service/iam" "github.com/google/uuid" ) @@ -26,7 +27,7 @@ func connectProvisioned(ctx context.Context, instanceName string, retryConfig li return err } - user, err := w.CurrentUser.Me(ctx) + user, err := w.CurrentUser.Me(ctx, iam.MeRequest{}) if err != nil { return fmt.Errorf("failed to get current user: %w", err) } diff --git a/cmd/sync/completion.go b/cmd/sync/completion.go index 52d49d6cb1c..bc34c1581ac 100644 --- a/cmd/sync/completion.go +++ b/cmd/sync/completion.go @@ -6,6 +6,7 @@ import ( "strings" "github.com/databricks/databricks-sdk-go" + "github.com/databricks/databricks-sdk-go/service/iam" "github.com/databricks/databricks-sdk-go/service/workspace" "github.com/spf13/cobra" ) @@ -44,7 +45,7 @@ func completeRemotePath( wsc *databricks.WorkspaceClient, toComplete string, ) ([]string, cobra.ShellCompDirective) { - me, err := wsc.CurrentUser.Me(ctx) + me, err := wsc.CurrentUser.Me(ctx, iam.MeRequest{}) if err != nil { return nil, cobra.ShellCompDirectiveError } diff --git a/cmd/workspace/bundle/bundle.go b/cmd/workspace/bundle/bundle.go new file mode 100755 index 00000000000..e7bd045f3a3 --- /dev/null +++ b/cmd/workspace/bundle/bundle.go @@ -0,0 +1,1108 @@ +// Code generated from OpenAPI specs by Databricks SDK Generator. DO NOT EDIT. + +package bundle + +import ( + "fmt" + + "github.com/databricks/cli/cmd/root" + "github.com/databricks/cli/libs/cmdctx" + "github.com/databricks/cli/libs/cmdio" + "github.com/databricks/cli/libs/flags" + "github.com/databricks/databricks-sdk-go/service/bundle" + "github.com/spf13/cobra" +) + +// Slice with functions to override default command behavior. +// Functions can be added from the `init()` function in manually curated files in this directory. +var cmdOverrides []func(*cobra.Command) + +func New() *cobra.Command { + cmd := &cobra.Command{ + Use: "bundle", + Short: `Service for managing bundle deployment metadata.`, + Long: `Service for managing bundle deployment metadata.`, + GroupID: "bundle", + + // This service is being previewed; hide from help output. + Hidden: true, + RunE: root.ReportUnknownSubcommand, + } + + cmd.Annotations = make(map[string]string) + cmd.Annotations["launch_stage"] = "PRIVATE_PREVIEW" + cmd.Annotations["launch_stage_display"] = "Private Preview" + + // Add methods + cmd.AddCommand(newCompleteVersion()) + cmd.AddCommand(newCreateDeployment()) + cmd.AddCommand(newCreateOperation()) + cmd.AddCommand(newCreateVersion()) + cmd.AddCommand(newDeleteDeployment()) + cmd.AddCommand(newGetDeployment()) + cmd.AddCommand(newGetOperation()) + cmd.AddCommand(newGetResource()) + cmd.AddCommand(newGetVersion()) + cmd.AddCommand(newHeartbeat()) + cmd.AddCommand(newListDeployments()) + cmd.AddCommand(newListOperations()) + cmd.AddCommand(newListResources()) + cmd.AddCommand(newListVersions()) + + // Apply optional overrides to this command. + for _, fn := range cmdOverrides { + fn(cmd) + } + + return cmd +} + +// start complete-version command + +// Slice with functions to override default command behavior. +// Functions can be added from the `init()` function in manually curated files in this directory. +var completeVersionOverrides []func( + *cobra.Command, + *bundle.CompleteVersionRequest, +) + +func newCompleteVersion() *cobra.Command { + cmd := &cobra.Command{} + + var completeVersionReq bundle.CompleteVersionRequest + var completeVersionJson flags.JsonFlag + + cmd.Flags().Var(&completeVersionJson, "json", `either inline JSON string or @path/to/file.json with request body`) + + cmd.Flags().BoolVar(&completeVersionReq.Force, "force", completeVersionReq.Force, `If true, force-completes the version even if the caller is not the original creator.`) + + cmd.Use = "complete-version NAME COMPLETION_REASON" + cmd.Short = `Complete a version.` + cmd.Long = `Complete a version. + + Marks a version as complete and releases the deployment lock. + + The server atomically: 1. Sets the version status to the provided terminal + status. 2. Sets complete_time to the current server timestamp. 3. Releases + the lock on the parent deployment. 4. Updates the parent deployment's status + and last_version_id. + + Arguments: + NAME: The name of the version to complete. Format: + deployments/{deployment_id}/versions/{version_id} + COMPLETION_REASON: The reason for completing the version. Must be a terminal reason: + VERSION_COMPLETE_SUCCESS, VERSION_COMPLETE_FAILURE, or + VERSION_COMPLETE_FORCE_ABORT. + Supported values: [VERSION_COMPLETE_FAILURE, VERSION_COMPLETE_FORCE_ABORT, VERSION_COMPLETE_LEASE_EXPIRED, VERSION_COMPLETE_SUCCESS]` + + cmd.Annotations = make(map[string]string) + cmd.Annotations["launch_stage"] = "PRIVATE_PREVIEW" + cmd.Annotations["launch_stage_display"] = "Private Preview" + + cmd.Args = func(cmd *cobra.Command, args []string) error { + if cmd.Flags().Changed("json") { + err := root.ExactArgs(1)(cmd, args) + if err != nil { + return fmt.Errorf("when --json flag is specified, provide only NAME as positional arguments. Provide 'completion_reason' in your JSON input") + } + return nil + } + check := root.ExactArgs(2) + return check(cmd, args) + } + + cmd.PreRunE = root.MustWorkspaceClient + cmd.RunE = func(cmd *cobra.Command, args []string) (err error) { + ctx := cmd.Context() + w := cmdctx.WorkspaceClient(ctx) + + if cmd.Flags().Changed("json") { + diags := completeVersionJson.Unmarshal(&completeVersionReq) + if diags.HasError() { + return diags.Error() + } + if len(diags) > 0 { + err := cmdio.RenderDiagnostics(ctx, diags) + if err != nil { + return err + } + } + } + completeVersionReq.Name = args[0] + if !cmd.Flags().Changed("json") { + _, err = fmt.Sscan(args[1], &completeVersionReq.CompletionReason) + if err != nil { + return fmt.Errorf("invalid COMPLETION_REASON: %s", args[1]) + } + + } + + response, err := w.Bundle.CompleteVersion(ctx, completeVersionReq) + if err != nil { + return err + } + + return cmdio.Render(ctx, response) + } + + // Disable completions since they are not applicable. + // Can be overridden by manual implementation in `override.go`. + cmd.ValidArgsFunction = cobra.NoFileCompletions + + // Apply optional overrides to this command. + for _, fn := range completeVersionOverrides { + fn(cmd, &completeVersionReq) + } + + return cmd +} + +// start create-deployment command + +// Slice with functions to override default command behavior. +// Functions can be added from the `init()` function in manually curated files in this directory. +var createDeploymentOverrides []func( + *cobra.Command, + *bundle.CreateDeploymentRequest, +) + +func newCreateDeployment() *cobra.Command { + cmd := &cobra.Command{} + + var createDeploymentReq bundle.CreateDeploymentRequest + createDeploymentReq.Deployment = bundle.Deployment{} + var createDeploymentJson flags.JsonFlag + + cmd.Flags().Var(&createDeploymentJson, "json", `either inline JSON string or @path/to/file.json with request body`) + + cmd.Flags().StringVar(&createDeploymentReq.Deployment.DisplayName, "display-name", createDeploymentReq.Deployment.DisplayName, `Human-readable name for the deployment.`) + cmd.Flags().StringVar(&createDeploymentReq.Deployment.TargetName, "target-name", createDeploymentReq.Deployment.TargetName, `The bundle target name associated with this deployment.`) + + cmd.Use = "create-deployment DEPLOYMENT_ID" + cmd.Short = `Create a deployment.` + cmd.Long = `Create a deployment. + + Creates a new deployment in the workspace. + + The caller must provide a deployment_id which becomes the final component of + the deployment's resource name. If a deployment with the same ID already + exists, the server returns ALREADY_EXISTS. + + Arguments: + DEPLOYMENT_ID: The ID to use for the deployment, which will become the final component of + the deployment's resource name (i.e. deployments/{deployment_id}).` + + cmd.Annotations = make(map[string]string) + cmd.Annotations["launch_stage"] = "PRIVATE_PREVIEW" + cmd.Annotations["launch_stage_display"] = "Private Preview" + + cmd.Args = func(cmd *cobra.Command, args []string) error { + check := root.ExactArgs(1) + return check(cmd, args) + } + + cmd.PreRunE = root.MustWorkspaceClient + cmd.RunE = func(cmd *cobra.Command, args []string) (err error) { + ctx := cmd.Context() + w := cmdctx.WorkspaceClient(ctx) + + if cmd.Flags().Changed("json") { + diags := createDeploymentJson.Unmarshal(&createDeploymentReq.Deployment) + if diags.HasError() { + return diags.Error() + } + if len(diags) > 0 { + err := cmdio.RenderDiagnostics(ctx, diags) + if err != nil { + return err + } + } + } + createDeploymentReq.DeploymentId = args[0] + + response, err := w.Bundle.CreateDeployment(ctx, createDeploymentReq) + if err != nil { + return err + } + + return cmdio.Render(ctx, response) + } + + // Disable completions since they are not applicable. + // Can be overridden by manual implementation in `override.go`. + cmd.ValidArgsFunction = cobra.NoFileCompletions + + // Apply optional overrides to this command. + for _, fn := range createDeploymentOverrides { + fn(cmd, &createDeploymentReq) + } + + return cmd +} + +// start create-operation command + +// Slice with functions to override default command behavior. +// Functions can be added from the `init()` function in manually curated files in this directory. +var createOperationOverrides []func( + *cobra.Command, + *bundle.CreateOperationRequest, +) + +func newCreateOperation() *cobra.Command { + cmd := &cobra.Command{} + + var createOperationReq bundle.CreateOperationRequest + createOperationReq.Operation = bundle.Operation{} + var createOperationJson flags.JsonFlag + + cmd.Flags().Var(&createOperationJson, "json", `either inline JSON string or @path/to/file.json with request body`) + + cmd.Use = "create-operation PARENT" + cmd.Short = `Create an operation.` + cmd.Long = `Create an operation. + + Creates a resource operation under a version. + + The caller must provide a resource_key which becomes the final component of + the operation's name. If an operation with the same key already exists under + the version, the server returns ALREADY_EXISTS. + + On success the server also updates the corresponding deployment-level Resource + (creating it if this is the first operation for that resource_key, or removing + it if action_type is DELETE). + + Arguments: + PARENT: The parent version where this operation will be recorded. Format: + deployments/{deployment_id}/versions/{version_id}` + + cmd.Annotations = make(map[string]string) + cmd.Annotations["launch_stage"] = "PRIVATE_PREVIEW" + cmd.Annotations["launch_stage_display"] = "Private Preview" + + cmd.Args = func(cmd *cobra.Command, args []string) error { + if cmd.Flags().Changed("json") { + err := root.ExactArgs(2)(cmd, args) + if err != nil { + return fmt.Errorf("when --json flag is specified, provide only PARENT, RESOURCE_KEY as positional arguments. Provide 'action_type', 'resource_id', 'status' in your JSON input") + } + return nil + } + check := root.ExactArgs(1) + return check(cmd, args) + } + + cmd.PreRunE = root.MustWorkspaceClient + cmd.RunE = func(cmd *cobra.Command, args []string) (err error) { + ctx := cmd.Context() + w := cmdctx.WorkspaceClient(ctx) + + if cmd.Flags().Changed("json") { + diags := createOperationJson.Unmarshal(&createOperationReq.Operation) + if diags.HasError() { + return diags.Error() + } + if len(diags) > 0 { + err := cmdio.RenderDiagnostics(ctx, diags) + if err != nil { + return err + } + } + } else { + return fmt.Errorf("please provide command input in JSON format by specifying the --json flag") + } + createOperationReq.Parent = args[0] + + response, err := w.Bundle.CreateOperation(ctx, createOperationReq) + if err != nil { + return err + } + + return cmdio.Render(ctx, response) + } + + // Disable completions since they are not applicable. + // Can be overridden by manual implementation in `override.go`. + cmd.ValidArgsFunction = cobra.NoFileCompletions + + // Apply optional overrides to this command. + for _, fn := range createOperationOverrides { + fn(cmd, &createOperationReq) + } + + return cmd +} + +// start create-version command + +// Slice with functions to override default command behavior. +// Functions can be added from the `init()` function in manually curated files in this directory. +var createVersionOverrides []func( + *cobra.Command, + *bundle.CreateVersionRequest, +) + +func newCreateVersion() *cobra.Command { + cmd := &cobra.Command{} + + var createVersionReq bundle.CreateVersionRequest + createVersionReq.Version = bundle.Version{} + var createVersionJson flags.JsonFlag + + cmd.Flags().Var(&createVersionJson, "json", `either inline JSON string or @path/to/file.json with request body`) + + cmd.Flags().StringVar(&createVersionReq.Version.DisplayName, "display-name", createVersionReq.Version.DisplayName, `Display name for the deployment, captured at the time of this version.`) + cmd.Flags().StringVar(&createVersionReq.Version.TargetName, "target-name", createVersionReq.Version.TargetName, `Target name of the deployment, captured at the time of this version.`) + + cmd.Use = "create-version PARENT VERSION_ID CLI_VERSION VERSION_TYPE" + cmd.Short = `Create a version.` + cmd.Long = `Create a version. + + Creates a new version under a deployment. + + Creating a version acquires an exclusive lock on the deployment, preventing + concurrent deploys. The caller provides a version_id which the server + validates equals last_version_id + 1 on the deployment. + + Arguments: + PARENT: The parent deployment where this version will be created. Format: + deployments/{deployment_id} + VERSION_ID: The version ID the caller expects to create. The server validates this + equals last_version_id + 1 on the deployment. If it doesn't match, the + server returns ABORTED. + CLI_VERSION: CLI version used to initiate the version. + VERSION_TYPE: Type of version (deploy or destroy). + Supported values: [VERSION_TYPE_DEPLOY, VERSION_TYPE_DESTROY]` + + cmd.Annotations = make(map[string]string) + cmd.Annotations["launch_stage"] = "PRIVATE_PREVIEW" + cmd.Annotations["launch_stage_display"] = "Private Preview" + + cmd.Args = func(cmd *cobra.Command, args []string) error { + if cmd.Flags().Changed("json") { + err := root.ExactArgs(2)(cmd, args) + if err != nil { + return fmt.Errorf("when --json flag is specified, provide only PARENT, VERSION_ID as positional arguments. Provide 'cli_version', 'version_type' in your JSON input") + } + return nil + } + check := root.ExactArgs(4) + return check(cmd, args) + } + + cmd.PreRunE = root.MustWorkspaceClient + cmd.RunE = func(cmd *cobra.Command, args []string) (err error) { + ctx := cmd.Context() + w := cmdctx.WorkspaceClient(ctx) + + if cmd.Flags().Changed("json") { + diags := createVersionJson.Unmarshal(&createVersionReq.Version) + if diags.HasError() { + return diags.Error() + } + if len(diags) > 0 { + err := cmdio.RenderDiagnostics(ctx, diags) + if err != nil { + return err + } + } + } + createVersionReq.Parent = args[0] + createVersionReq.VersionId = args[1] + if !cmd.Flags().Changed("json") { + createVersionReq.Version.CliVersion = args[2] + } + if !cmd.Flags().Changed("json") { + _, err = fmt.Sscan(args[3], &createVersionReq.Version.VersionType) + if err != nil { + return fmt.Errorf("invalid VERSION_TYPE: %s", args[3]) + } + + } + + response, err := w.Bundle.CreateVersion(ctx, createVersionReq) + if err != nil { + return err + } + + return cmdio.Render(ctx, response) + } + + // Disable completions since they are not applicable. + // Can be overridden by manual implementation in `override.go`. + cmd.ValidArgsFunction = cobra.NoFileCompletions + + // Apply optional overrides to this command. + for _, fn := range createVersionOverrides { + fn(cmd, &createVersionReq) + } + + return cmd +} + +// start delete-deployment command + +// Slice with functions to override default command behavior. +// Functions can be added from the `init()` function in manually curated files in this directory. +var deleteDeploymentOverrides []func( + *cobra.Command, + *bundle.DeleteDeploymentRequest, +) + +func newDeleteDeployment() *cobra.Command { + cmd := &cobra.Command{} + + var deleteDeploymentReq bundle.DeleteDeploymentRequest + + cmd.Use = "delete-deployment NAME" + cmd.Short = `Delete a deployment.` + cmd.Long = `Delete a deployment. + + Deletes a deployment. + + The deployment is marked as deleted. It and all its children (versions and + their operations) will be permanently deleted after the retention policy + expires. If the deployment has an in-progress version, the server returns + RESOURCE_CONFLICT. + + Arguments: + NAME: Resource name of the deployment to delete. Format: + deployments/{deployment_id}` + + cmd.Annotations = make(map[string]string) + cmd.Annotations["launch_stage"] = "PRIVATE_PREVIEW" + cmd.Annotations["launch_stage_display"] = "Private Preview" + + cmd.Args = func(cmd *cobra.Command, args []string) error { + check := root.ExactArgs(1) + return check(cmd, args) + } + + cmd.PreRunE = root.MustWorkspaceClient + cmd.RunE = func(cmd *cobra.Command, args []string) (err error) { + ctx := cmd.Context() + w := cmdctx.WorkspaceClient(ctx) + + deleteDeploymentReq.Name = args[0] + + err = w.Bundle.DeleteDeployment(ctx, deleteDeploymentReq) + if err != nil { + return err + } + return nil + } + + // Disable completions since they are not applicable. + // Can be overridden by manual implementation in `override.go`. + cmd.ValidArgsFunction = cobra.NoFileCompletions + + // Apply optional overrides to this command. + for _, fn := range deleteDeploymentOverrides { + fn(cmd, &deleteDeploymentReq) + } + + return cmd +} + +// start get-deployment command + +// Slice with functions to override default command behavior. +// Functions can be added from the `init()` function in manually curated files in this directory. +var getDeploymentOverrides []func( + *cobra.Command, + *bundle.GetDeploymentRequest, +) + +func newGetDeployment() *cobra.Command { + cmd := &cobra.Command{} + + var getDeploymentReq bundle.GetDeploymentRequest + + cmd.Use = "get-deployment NAME" + cmd.Short = `Get a deployment.` + cmd.Long = `Get a deployment. + + Retrieves a deployment by its resource name. + + Arguments: + NAME: Resource name of the deployment to retrieve. Format: + deployments/{deployment_id}` + + cmd.Annotations = make(map[string]string) + cmd.Annotations["launch_stage"] = "PRIVATE_PREVIEW" + cmd.Annotations["launch_stage_display"] = "Private Preview" + + cmd.Args = func(cmd *cobra.Command, args []string) error { + check := root.ExactArgs(1) + return check(cmd, args) + } + + cmd.PreRunE = root.MustWorkspaceClient + cmd.RunE = func(cmd *cobra.Command, args []string) (err error) { + ctx := cmd.Context() + w := cmdctx.WorkspaceClient(ctx) + + getDeploymentReq.Name = args[0] + + response, err := w.Bundle.GetDeployment(ctx, getDeploymentReq) + if err != nil { + return err + } + + return cmdio.Render(ctx, response) + } + + // Disable completions since they are not applicable. + // Can be overridden by manual implementation in `override.go`. + cmd.ValidArgsFunction = cobra.NoFileCompletions + + // Apply optional overrides to this command. + for _, fn := range getDeploymentOverrides { + fn(cmd, &getDeploymentReq) + } + + return cmd +} + +// start get-operation command + +// Slice with functions to override default command behavior. +// Functions can be added from the `init()` function in manually curated files in this directory. +var getOperationOverrides []func( + *cobra.Command, + *bundle.GetOperationRequest, +) + +func newGetOperation() *cobra.Command { + cmd := &cobra.Command{} + + var getOperationReq bundle.GetOperationRequest + + cmd.Use = "get-operation NAME" + cmd.Short = `Get an operation.` + cmd.Long = `Get an operation. + + Retrieves a resource operation by its resource name. + + Arguments: + NAME: The name of the resource operation to retrieve. Format: + deployments/{deployment_id}/versions/{version_id}/operations/{resource_key}` + + cmd.Annotations = make(map[string]string) + cmd.Annotations["launch_stage"] = "PRIVATE_PREVIEW" + cmd.Annotations["launch_stage_display"] = "Private Preview" + + cmd.Args = func(cmd *cobra.Command, args []string) error { + check := root.ExactArgs(1) + return check(cmd, args) + } + + cmd.PreRunE = root.MustWorkspaceClient + cmd.RunE = func(cmd *cobra.Command, args []string) (err error) { + ctx := cmd.Context() + w := cmdctx.WorkspaceClient(ctx) + + getOperationReq.Name = args[0] + + response, err := w.Bundle.GetOperation(ctx, getOperationReq) + if err != nil { + return err + } + + return cmdio.Render(ctx, response) + } + + // Disable completions since they are not applicable. + // Can be overridden by manual implementation in `override.go`. + cmd.ValidArgsFunction = cobra.NoFileCompletions + + // Apply optional overrides to this command. + for _, fn := range getOperationOverrides { + fn(cmd, &getOperationReq) + } + + return cmd +} + +// start get-resource command + +// Slice with functions to override default command behavior. +// Functions can be added from the `init()` function in manually curated files in this directory. +var getResourceOverrides []func( + *cobra.Command, + *bundle.GetResourceRequest, +) + +func newGetResource() *cobra.Command { + cmd := &cobra.Command{} + + var getResourceReq bundle.GetResourceRequest + + cmd.Use = "get-resource NAME" + cmd.Short = `Get a resource.` + cmd.Long = `Get a resource. + + Retrieves a deployment resource by its resource name. + + Arguments: + NAME: The name of the resource to retrieve. Format: + deployments/{deployment_id}/resources/{resource_key}` + + cmd.Annotations = make(map[string]string) + cmd.Annotations["launch_stage"] = "PRIVATE_PREVIEW" + cmd.Annotations["launch_stage_display"] = "Private Preview" + + cmd.Args = func(cmd *cobra.Command, args []string) error { + check := root.ExactArgs(1) + return check(cmd, args) + } + + cmd.PreRunE = root.MustWorkspaceClient + cmd.RunE = func(cmd *cobra.Command, args []string) (err error) { + ctx := cmd.Context() + w := cmdctx.WorkspaceClient(ctx) + + getResourceReq.Name = args[0] + + response, err := w.Bundle.GetResource(ctx, getResourceReq) + if err != nil { + return err + } + + return cmdio.Render(ctx, response) + } + + // Disable completions since they are not applicable. + // Can be overridden by manual implementation in `override.go`. + cmd.ValidArgsFunction = cobra.NoFileCompletions + + // Apply optional overrides to this command. + for _, fn := range getResourceOverrides { + fn(cmd, &getResourceReq) + } + + return cmd +} + +// start get-version command + +// Slice with functions to override default command behavior. +// Functions can be added from the `init()` function in manually curated files in this directory. +var getVersionOverrides []func( + *cobra.Command, + *bundle.GetVersionRequest, +) + +func newGetVersion() *cobra.Command { + cmd := &cobra.Command{} + + var getVersionReq bundle.GetVersionRequest + + cmd.Use = "get-version NAME" + cmd.Short = `Get a version.` + cmd.Long = `Get a version. + + Retrieves a version by its resource name. + + Arguments: + NAME: The name of the version to retrieve. Format: + deployments/{deployment_id}/versions/{version_id}` + + cmd.Annotations = make(map[string]string) + cmd.Annotations["launch_stage"] = "PRIVATE_PREVIEW" + cmd.Annotations["launch_stage_display"] = "Private Preview" + + cmd.Args = func(cmd *cobra.Command, args []string) error { + check := root.ExactArgs(1) + return check(cmd, args) + } + + cmd.PreRunE = root.MustWorkspaceClient + cmd.RunE = func(cmd *cobra.Command, args []string) (err error) { + ctx := cmd.Context() + w := cmdctx.WorkspaceClient(ctx) + + getVersionReq.Name = args[0] + + response, err := w.Bundle.GetVersion(ctx, getVersionReq) + if err != nil { + return err + } + + return cmdio.Render(ctx, response) + } + + // Disable completions since they are not applicable. + // Can be overridden by manual implementation in `override.go`. + cmd.ValidArgsFunction = cobra.NoFileCompletions + + // Apply optional overrides to this command. + for _, fn := range getVersionOverrides { + fn(cmd, &getVersionReq) + } + + return cmd +} + +// start heartbeat command + +// Slice with functions to override default command behavior. +// Functions can be added from the `init()` function in manually curated files in this directory. +var heartbeatOverrides []func( + *cobra.Command, + *bundle.HeartbeatRequest, +) + +func newHeartbeat() *cobra.Command { + cmd := &cobra.Command{} + + var heartbeatReq bundle.HeartbeatRequest + + cmd.Use = "heartbeat NAME" + cmd.Short = `Send a version heartbeat.` + cmd.Long = `Send a version heartbeat. + + Sends a heartbeat to renew the lock held by a version. + + The server validates that the version is the active (non-terminal) version on + the parent deployment and resets the lock expiry. If the lock has already + expired or the version is no longer active, the server returns ABORTED. + + Arguments: + NAME: The version whose lock to renew. Format: + deployments/{deployment_id}/versions/{version_id}` + + cmd.Annotations = make(map[string]string) + cmd.Annotations["launch_stage"] = "PRIVATE_PREVIEW" + cmd.Annotations["launch_stage_display"] = "Private Preview" + + cmd.Args = func(cmd *cobra.Command, args []string) error { + check := root.ExactArgs(1) + return check(cmd, args) + } + + cmd.PreRunE = root.MustWorkspaceClient + cmd.RunE = func(cmd *cobra.Command, args []string) (err error) { + ctx := cmd.Context() + w := cmdctx.WorkspaceClient(ctx) + + heartbeatReq.Name = args[0] + + response, err := w.Bundle.Heartbeat(ctx, heartbeatReq) + if err != nil { + return err + } + + return cmdio.Render(ctx, response) + } + + // Disable completions since they are not applicable. + // Can be overridden by manual implementation in `override.go`. + cmd.ValidArgsFunction = cobra.NoFileCompletions + + // Apply optional overrides to this command. + for _, fn := range heartbeatOverrides { + fn(cmd, &heartbeatReq) + } + + return cmd +} + +// start list-deployments command + +// Slice with functions to override default command behavior. +// Functions can be added from the `init()` function in manually curated files in this directory. +var listDeploymentsOverrides []func( + *cobra.Command, + *bundle.ListDeploymentsRequest, +) + +func newListDeployments() *cobra.Command { + cmd := &cobra.Command{} + + var listDeploymentsReq bundle.ListDeploymentsRequest + // Registered for all paginated methods. Validated at call time in the + // method-call template. Paginated list methods never have Wait or LRO + // branches, so the method-call path is always reached. + var listDeploymentsLimit int + + cmd.Flags().IntVar(&listDeploymentsReq.PageSize, "page-size", listDeploymentsReq.PageSize, `The maximum number of deployments to return.`) + + // Limit flag for total result capping. + cmd.Flags().IntVar(&listDeploymentsLimit, "limit", 0, `Maximum number of results to return.`) + + // Hidden pagination flags (internal API parameters). + cmd.Flags().StringVar(&listDeploymentsReq.PageToken, "page-token", listDeploymentsReq.PageToken, `Pagination token.`) + cmd.Flags().Lookup("page-token").Hidden = true + + cmd.Use = "list-deployments" + cmd.Short = `List deployments.` + cmd.Long = `List deployments. + + Lists deployments in the workspace.` + + cmd.Annotations = make(map[string]string) + cmd.Annotations["launch_stage"] = "PRIVATE_PREVIEW" + cmd.Annotations["launch_stage_display"] = "Private Preview" + + cmd.Args = func(cmd *cobra.Command, args []string) error { + check := root.ExactArgs(0) + return check(cmd, args) + } + + cmd.PreRunE = root.MustWorkspaceClient + cmd.RunE = func(cmd *cobra.Command, args []string) (err error) { + ctx := cmd.Context() + w := cmdctx.WorkspaceClient(ctx) + + response := w.Bundle.ListDeployments(ctx, listDeploymentsReq) + if listDeploymentsLimit < 0 { + return fmt.Errorf("--limit must be a non-negative integer, got %d", listDeploymentsLimit) + } + if listDeploymentsLimit > 0 { + ctx = cmdio.WithLimit(ctx, listDeploymentsLimit) + } + + return cmdio.RenderIterator(ctx, response) + } + + // Disable completions since they are not applicable. + // Can be overridden by manual implementation in `override.go`. + cmd.ValidArgsFunction = cobra.NoFileCompletions + + // Apply optional overrides to this command. + for _, fn := range listDeploymentsOverrides { + fn(cmd, &listDeploymentsReq) + } + + return cmd +} + +// start list-operations command + +// Slice with functions to override default command behavior. +// Functions can be added from the `init()` function in manually curated files in this directory. +var listOperationsOverrides []func( + *cobra.Command, + *bundle.ListOperationsRequest, +) + +func newListOperations() *cobra.Command { + cmd := &cobra.Command{} + + var listOperationsReq bundle.ListOperationsRequest + // Registered for all paginated methods. Validated at call time in the + // method-call template. Paginated list methods never have Wait or LRO + // branches, so the method-call path is always reached. + var listOperationsLimit int + + cmd.Flags().IntVar(&listOperationsReq.PageSize, "page-size", listOperationsReq.PageSize, `The maximum number of operations to return.`) + + // Limit flag for total result capping. + cmd.Flags().IntVar(&listOperationsLimit, "limit", 0, `Maximum number of results to return.`) + + // Hidden pagination flags (internal API parameters). + cmd.Flags().StringVar(&listOperationsReq.PageToken, "page-token", listOperationsReq.PageToken, `Pagination token.`) + cmd.Flags().Lookup("page-token").Hidden = true + + cmd.Use = "list-operations PARENT" + cmd.Short = `List operations.` + cmd.Long = `List operations. + + Lists resource operations under a version. + + Arguments: + PARENT: The parent version. Format: + deployments/{deployment_id}/versions/{version_id}` + + cmd.Annotations = make(map[string]string) + cmd.Annotations["launch_stage"] = "PRIVATE_PREVIEW" + cmd.Annotations["launch_stage_display"] = "Private Preview" + + cmd.Args = func(cmd *cobra.Command, args []string) error { + check := root.ExactArgs(1) + return check(cmd, args) + } + + cmd.PreRunE = root.MustWorkspaceClient + cmd.RunE = func(cmd *cobra.Command, args []string) (err error) { + ctx := cmd.Context() + w := cmdctx.WorkspaceClient(ctx) + + listOperationsReq.Parent = args[0] + + response := w.Bundle.ListOperations(ctx, listOperationsReq) + if listOperationsLimit < 0 { + return fmt.Errorf("--limit must be a non-negative integer, got %d", listOperationsLimit) + } + if listOperationsLimit > 0 { + ctx = cmdio.WithLimit(ctx, listOperationsLimit) + } + + return cmdio.RenderIterator(ctx, response) + } + + // Disable completions since they are not applicable. + // Can be overridden by manual implementation in `override.go`. + cmd.ValidArgsFunction = cobra.NoFileCompletions + + // Apply optional overrides to this command. + for _, fn := range listOperationsOverrides { + fn(cmd, &listOperationsReq) + } + + return cmd +} + +// start list-resources command + +// Slice with functions to override default command behavior. +// Functions can be added from the `init()` function in manually curated files in this directory. +var listResourcesOverrides []func( + *cobra.Command, + *bundle.ListResourcesRequest, +) + +func newListResources() *cobra.Command { + cmd := &cobra.Command{} + + var listResourcesReq bundle.ListResourcesRequest + // Registered for all paginated methods. Validated at call time in the + // method-call template. Paginated list methods never have Wait or LRO + // branches, so the method-call path is always reached. + var listResourcesLimit int + + cmd.Flags().IntVar(&listResourcesReq.PageSize, "page-size", listResourcesReq.PageSize, `The maximum number of resources to return.`) + + // Limit flag for total result capping. + cmd.Flags().IntVar(&listResourcesLimit, "limit", 0, `Maximum number of results to return.`) + + // Hidden pagination flags (internal API parameters). + cmd.Flags().StringVar(&listResourcesReq.PageToken, "page-token", listResourcesReq.PageToken, `Pagination token.`) + cmd.Flags().Lookup("page-token").Hidden = true + + cmd.Use = "list-resources PARENT" + cmd.Short = `List resources.` + cmd.Long = `List resources. + + Lists resources under a deployment. + + Arguments: + PARENT: The parent deployment. Format: deployments/{deployment_id}` + + cmd.Annotations = make(map[string]string) + cmd.Annotations["launch_stage"] = "PRIVATE_PREVIEW" + cmd.Annotations["launch_stage_display"] = "Private Preview" + + cmd.Args = func(cmd *cobra.Command, args []string) error { + check := root.ExactArgs(1) + return check(cmd, args) + } + + cmd.PreRunE = root.MustWorkspaceClient + cmd.RunE = func(cmd *cobra.Command, args []string) (err error) { + ctx := cmd.Context() + w := cmdctx.WorkspaceClient(ctx) + + listResourcesReq.Parent = args[0] + + response := w.Bundle.ListResources(ctx, listResourcesReq) + if listResourcesLimit < 0 { + return fmt.Errorf("--limit must be a non-negative integer, got %d", listResourcesLimit) + } + if listResourcesLimit > 0 { + ctx = cmdio.WithLimit(ctx, listResourcesLimit) + } + + return cmdio.RenderIterator(ctx, response) + } + + // Disable completions since they are not applicable. + // Can be overridden by manual implementation in `override.go`. + cmd.ValidArgsFunction = cobra.NoFileCompletions + + // Apply optional overrides to this command. + for _, fn := range listResourcesOverrides { + fn(cmd, &listResourcesReq) + } + + return cmd +} + +// start list-versions command + +// Slice with functions to override default command behavior. +// Functions can be added from the `init()` function in manually curated files in this directory. +var listVersionsOverrides []func( + *cobra.Command, + *bundle.ListVersionsRequest, +) + +func newListVersions() *cobra.Command { + cmd := &cobra.Command{} + + var listVersionsReq bundle.ListVersionsRequest + // Registered for all paginated methods. Validated at call time in the + // method-call template. Paginated list methods never have Wait or LRO + // branches, so the method-call path is always reached. + var listVersionsLimit int + + cmd.Flags().IntVar(&listVersionsReq.PageSize, "page-size", listVersionsReq.PageSize, `The maximum number of versions to return.`) + + // Limit flag for total result capping. + cmd.Flags().IntVar(&listVersionsLimit, "limit", 0, `Maximum number of results to return.`) + + // Hidden pagination flags (internal API parameters). + cmd.Flags().StringVar(&listVersionsReq.PageToken, "page-token", listVersionsReq.PageToken, `Pagination token.`) + cmd.Flags().Lookup("page-token").Hidden = true + + cmd.Use = "list-versions PARENT" + cmd.Short = `List versions.` + cmd.Long = `List versions. + + Lists versions under a deployment, ordered by version_id descending (most + recent first). + + Arguments: + PARENT: The parent deployment. Format: deployments/{deployment_id}` + + cmd.Annotations = make(map[string]string) + cmd.Annotations["launch_stage"] = "PRIVATE_PREVIEW" + cmd.Annotations["launch_stage_display"] = "Private Preview" + + cmd.Args = func(cmd *cobra.Command, args []string) error { + check := root.ExactArgs(1) + return check(cmd, args) + } + + cmd.PreRunE = root.MustWorkspaceClient + cmd.RunE = func(cmd *cobra.Command, args []string) (err error) { + ctx := cmd.Context() + w := cmdctx.WorkspaceClient(ctx) + + listVersionsReq.Parent = args[0] + + response := w.Bundle.ListVersions(ctx, listVersionsReq) + if listVersionsLimit < 0 { + return fmt.Errorf("--limit must be a non-negative integer, got %d", listVersionsLimit) + } + if listVersionsLimit > 0 { + ctx = cmdio.WithLimit(ctx, listVersionsLimit) + } + + return cmdio.RenderIterator(ctx, response) + } + + // Disable completions since they are not applicable. + // Can be overridden by manual implementation in `override.go`. + cmd.ValidArgsFunction = cobra.NoFileCompletions + + // Apply optional overrides to this command. + for _, fn := range listVersionsOverrides { + fn(cmd, &listVersionsReq) + } + + return cmd +} + +// end service Bundle diff --git a/cmd/workspace/cmd.go b/cmd/workspace/cmd.go index 189c08c9d5a..d944c6c90a2 100755 --- a/cmd/workspace/cmd.go +++ b/cmd/workspace/cmd.go @@ -11,6 +11,7 @@ import ( apps "github.com/databricks/cli/cmd/workspace/apps" apps_settings "github.com/databricks/cli/cmd/workspace/apps-settings" artifact_allowlists "github.com/databricks/cli/cmd/workspace/artifact-allowlists" + bundle "github.com/databricks/cli/cmd/workspace/bundle" catalogs "github.com/databricks/cli/cmd/workspace/catalogs" clean_room_asset_revisions "github.com/databricks/cli/cmd/workspace/clean-room-asset-revisions" clean_room_assets "github.com/databricks/cli/cmd/workspace/clean-room-assets" @@ -142,6 +143,7 @@ func All() []*cobra.Command { out = append(out, apps.New()) out = append(out, apps_settings.New()) out = append(out, artifact_allowlists.New()) + out = append(out, bundle.New()) out = append(out, catalogs.New()) out = append(out, clean_room_asset_revisions.New()) out = append(out, clean_room_assets.New()) diff --git a/cmd/workspace/consumer-listings/consumer-listings.go b/cmd/workspace/consumer-listings/consumer-listings.go index c8b257a51d4..f8113e3532a 100755 --- a/cmd/workspace/consumer-listings/consumer-listings.go +++ b/cmd/workspace/consumer-listings/consumer-listings.go @@ -201,7 +201,7 @@ func newList() *cobra.Command { cmd.Flags().BoolVar(&listReq.IsStaffPick, "is-staff-pick", listReq.IsStaffPick, `Filters each listing based on whether it is a staff pick.`) cmd.Flags().IntVar(&listReq.PageSize, "page-size", listReq.PageSize, ``) // TODO: array: provider_ids - // TODO: array: tags + // TODO: complex arg: tags // Limit flag for total result capping. cmd.Flags().IntVar(&listLimit, "limit", 0, `Maximum number of results to return.`) diff --git a/cmd/workspace/current-user/current-user.go b/cmd/workspace/current-user/current-user.go index 6bdd0075683..de32f481229 100755 --- a/cmd/workspace/current-user/current-user.go +++ b/cmd/workspace/current-user/current-user.go @@ -6,6 +6,7 @@ import ( "github.com/databricks/cli/cmd/root" "github.com/databricks/cli/libs/cmdctx" "github.com/databricks/cli/libs/cmdio" + "github.com/databricks/databricks-sdk-go/service/iam" "github.com/spf13/cobra" ) @@ -46,11 +47,17 @@ This API allows retrieving information about currently authenticated user or // Functions can be added from the `init()` function in manually curated files in this directory. var meOverrides []func( *cobra.Command, + *iam.MeRequest, ) func newMe() *cobra.Command { cmd := &cobra.Command{} + var meReq iam.MeRequest + + cmd.Flags().StringVar(&meReq.Attributes, "attributes", meReq.Attributes, `Comma-separated list of attributes to return in response.`) + cmd.Flags().StringVar(&meReq.ExcludedAttributes, "excluded-attributes", meReq.ExcludedAttributes, `Comma-separated list of attributes to exclude in response.`) + cmd.Use = "me" cmd.Short = `*Public Preview* Get current user info.` cmd.Long = `This command is in Public Preview and may change without notice. @@ -63,11 +70,17 @@ Get current user info. cmd.Annotations["launch_stage"] = "PUBLIC_PREVIEW" cmd.Annotations["launch_stage_display"] = "Public Preview" + cmd.Args = func(cmd *cobra.Command, args []string) error { + check := root.ExactArgs(0) + return check(cmd, args) + } + cmd.PreRunE = root.MustWorkspaceClient cmd.RunE = func(cmd *cobra.Command, args []string) (err error) { ctx := cmd.Context() w := cmdctx.WorkspaceClient(ctx) - response, err := w.CurrentUser.Me(ctx) + + response, err := w.CurrentUser.Me(ctx, meReq) if err != nil { return err } @@ -81,7 +94,7 @@ Get current user info. // Apply optional overrides to this command. for _, fn := range meOverrides { - fn(cmd) + fn(cmd, &meReq) } return cmd diff --git a/cmd/workspace/environments/environments.go b/cmd/workspace/environments/environments.go index 46de012fefc..97fc52874a7 100755 --- a/cmd/workspace/environments/environments.go +++ b/cmd/workspace/environments/environments.go @@ -466,7 +466,19 @@ func newListWorkspaceBaseEnvironments() *cobra.Command { cmd.Short = `List workspace base environments.` cmd.Long = `List workspace base environments. - Lists all WorkspaceBaseEnvironments in the workspace.` + Lists all WorkspaceBaseEnvironments in the workspace. + + Databricks provides the following base environments: + + - workspace-base-environments/databricks_ai_...: includes popular AI and + deep learning packages for serverless GPU compute. + + - workspace-base-environments/databricks_ml_...: includes popular ML + packages for serverless compute. + + Databricks-provided base environments are versioned. For example, + workspace-base-environments/databricks_ml_v5 corresponds to the ML + environment built on environment version 5.` cmd.Annotations = make(map[string]string) cmd.Annotations["launch_stage"] = "GA" diff --git a/cmd/workspace/experiments/experiments.go b/cmd/workspace/experiments/experiments.go index 23b9176cba7..6875a03b588 100755 --- a/cmd/workspace/experiments/experiments.go +++ b/cmd/workspace/experiments/experiments.go @@ -117,6 +117,8 @@ func newCreateExperiment() *cobra.Command { exists. Throws RESOURCE_ALREADY_EXISTS if an experiment with the given name exists. + Note: In some contexts, this error may be remapped to ALREADY_EXISTS. To be + safe, clients should check for both error codes. Arguments: NAME: Experiment name.` diff --git a/cmd/workspace/feature-engineering/feature-engineering.go b/cmd/workspace/feature-engineering/feature-engineering.go index fe4c98e74dc..a9d665fc17b 100755 --- a/cmd/workspace/feature-engineering/feature-engineering.go +++ b/cmd/workspace/feature-engineering/feature-engineering.go @@ -93,7 +93,9 @@ func newCreateFeature() *cobra.Command { Create a Feature. Arguments: - FULL_NAME: The full three-part name (catalog, schema, name) of the feature. + FULL_NAME: The full three-part name (catalog, schema, name) of the feature. This is + the feature's resource identifier; the catalog_name, schema_name, and name + fields below are OUTPUT_ONLY decomposed views of this value. SOURCE: The data source of the feature. FUNCTION: The function by which the feature is computed.` @@ -747,18 +749,22 @@ func newListFeatures() *cobra.Command { cmd.Flags().StringVar(&listFeaturesReq.PageToken, "page-token", listFeaturesReq.PageToken, `Pagination token.`) cmd.Flags().Lookup("page-token").Hidden = true - cmd.Use = "list-features" + cmd.Use = "list-features CATALOG_NAME SCHEMA_NAME" cmd.Short = `List features.` cmd.Long = `List features. - List Features.` + List Features. + + Arguments: + CATALOG_NAME: Name of parent catalog for features of interest. + SCHEMA_NAME: Name of parent schema relative to its parent catalog.` cmd.Annotations = make(map[string]string) cmd.Annotations["launch_stage"] = "PRIVATE_PREVIEW" cmd.Annotations["launch_stage_display"] = "Private Preview" cmd.Args = func(cmd *cobra.Command, args []string) error { - check := root.ExactArgs(0) + check := root.ExactArgs(2) return check(cmd, args) } @@ -767,6 +773,9 @@ func newListFeatures() *cobra.Command { ctx := cmd.Context() w := cmdctx.WorkspaceClient(ctx) + listFeaturesReq.CatalogName = args[0] + listFeaturesReq.SchemaName = args[1] + response := w.FeatureEngineering.ListFeatures(ctx, listFeaturesReq) if listFeaturesLimit < 0 { return fmt.Errorf("--limit must be a non-negative integer, got %d", listFeaturesLimit) @@ -964,7 +973,9 @@ func newUpdateFeature() *cobra.Command { Update a Feature. Arguments: - FULL_NAME: The full three-part name (catalog, schema, name) of the feature. + FULL_NAME: The full three-part name (catalog, schema, name) of the feature. This is + the feature's resource identifier; the catalog_name, schema_name, and name + fields below are OUTPUT_ONLY decomposed views of this value. UPDATE_MASK: The list of fields to update. SOURCE: The data source of the feature. FUNCTION: The function by which the feature is computed.` diff --git a/cmd/workspace/groups.go b/cmd/workspace/groups.go index 8dd096ee630..985b4815695 100644 --- a/cmd/workspace/groups.go +++ b/cmd/workspace/groups.go @@ -108,5 +108,9 @@ func Groups() []cobra.Group { ID: "environments", Title: "Environments", }, + { + ID: "bundle", + Title: "Bundle", + }, } } diff --git a/cmd/workspace/jobs/jobs.go b/cmd/workspace/jobs/jobs.go index 0fb5081bafb..be26fc586d0 100755 --- a/cmd/workspace/jobs/jobs.go +++ b/cmd/workspace/jobs/jobs.go @@ -635,6 +635,7 @@ func newGet() *cobra.Command { var getReq jobs.GetJobRequest + cmd.Flags().BoolVar(&getReq.IncludeTriggerState, "include-trigger-state", getReq.IncludeTriggerState, `Flag that indicates that trigger state should be included in the response.`) cmd.Flags().StringVar(&getReq.PageToken, "page-token", getReq.PageToken, `Use next_page_token returned from the previous GetJob response to request the next page of the job's array properties.`) cmd.Use = "get JOB_ID" diff --git a/cmd/workspace/postgres/postgres.go b/cmd/workspace/postgres/postgres.go index 5367e36f3f3..df28feb58ce 100755 --- a/cmd/workspace/postgres/postgres.go +++ b/cmd/workspace/postgres/postgres.go @@ -76,6 +76,7 @@ Use the Postgres API to create and manage Lakebase Autoscaling Postgres cmd.AddCommand(newListEndpoints()) cmd.AddCommand(newListProjects()) cmd.AddCommand(newListRoles()) + cmd.AddCommand(newUndeleteBranch()) cmd.AddCommand(newUndeleteProject()) cmd.AddCommand(newUpdateBranch()) cmd.AddCommand(newUpdateDatabase()) @@ -1006,6 +1007,8 @@ func newDeleteBranch() *cobra.Command { cmd.Flags().BoolVar(&deleteBranchSkipWait, "no-wait", deleteBranchSkipWait, `do not wait to reach DONE state`) cmd.Flags().DurationVar(&deleteBranchTimeout, "timeout", 0, `maximum amount of time to reach DONE state`) + cmd.Flags().BoolVar(&deleteBranchReq.Purge, "purge", deleteBranchReq.Purge, `If true, permanently delete the branch; if false, soft delete.`) + cmd.Use = "delete-branch NAME" cmd.Short = `*Beta* Delete a Branch.` cmd.Long = `This command is in Beta and may change without notice. @@ -1743,9 +1746,8 @@ func newGenerateDatabaseCredential() *cobra.Command { Generate OAuth credentials for a Postgres database. Arguments: - ENDPOINT: This field is not yet supported. The endpoint for which this credential - will be generated. Format: - projects/{project_id}/branches/{branch_id}/endpoints/{endpoint_id}` + ENDPOINT: The endpoint resource name for which this credential will be generated. + Format: projects/{project_id}/branches/{branch_id}/endpoints/{endpoint_id}` cmd.Annotations = make(map[string]string) cmd.Annotations["launch_stage"] = "PUBLIC_BETA" @@ -2319,6 +2321,7 @@ func newListBranches() *cobra.Command { var listBranchesLimit int cmd.Flags().IntVar(&listBranchesReq.PageSize, "page-size", listBranchesReq.PageSize, `Upper bound for items returned.`) + cmd.Flags().BoolVar(&listBranchesReq.ShowDeleted, "show-deleted", listBranchesReq.ShowDeleted, `Whether to include soft-deleted branches in the response.`) // Limit flag for total result capping. cmd.Flags().IntVar(&listBranchesLimit, "limit", 0, `Maximum number of results to return.`) @@ -2687,6 +2690,111 @@ List Postgres Roles for a Branch. return cmd } +// start undelete-branch command + +// Slice with functions to override default command behavior. +// Functions can be added from the `init()` function in manually curated files in this directory. +var undeleteBranchOverrides []func( + *cobra.Command, + *postgres.UndeleteBranchRequest, +) + +func newUndeleteBranch() *cobra.Command { + cmd := &cobra.Command{} + + var undeleteBranchReq postgres.UndeleteBranchRequest + + var undeleteBranchSkipWait bool + var undeleteBranchTimeout time.Duration + + cmd.Flags().BoolVar(&undeleteBranchSkipWait, "no-wait", undeleteBranchSkipWait, `do not wait to reach DONE state`) + cmd.Flags().DurationVar(&undeleteBranchTimeout, "timeout", 0, `maximum amount of time to reach DONE state`) + + cmd.Use = "undelete-branch NAME" + cmd.Short = `Undelete a Branch.` + cmd.Long = `Undelete a Branch. + + Undeletes the specified database branch. + + This is a long-running operation. By default, the command waits for the + operation to complete. Use --no-wait to return immediately with the raw + operation details. The operation's 'name' field can then be used to poll for + completion using the get-operation command. + + Arguments: + NAME: The full resource path of the branch to undelete. Format: + projects/{project_id}/branches/{branch_id}` + + // This command is being previewed; hide from help output. + cmd.Hidden = true + + cmd.Annotations = make(map[string]string) + cmd.Annotations["launch_stage"] = "PRIVATE_PREVIEW" + cmd.Annotations["launch_stage_display"] = "Private Preview" + + cmd.Args = func(cmd *cobra.Command, args []string) error { + check := root.ExactArgs(1) + return check(cmd, args) + } + + cmd.PreRunE = root.MustWorkspaceClient + cmd.RunE = func(cmd *cobra.Command, args []string) (err error) { + ctx := cmd.Context() + w := cmdctx.WorkspaceClient(ctx) + + undeleteBranchReq.Name = args[0] + + // Determine which mode to execute based on flags. + switch { + case undeleteBranchSkipWait: + wait, err := w.Postgres.UndeleteBranch(ctx, undeleteBranchReq) + if err != nil { + return err + } + + // Return operation immediately without waiting. + operation, err := w.Postgres.GetOperation(ctx, postgres.GetOperationRequest{ + Name: wait.Name(), + }) + if err != nil { + return err + } + return cmdio.Render(ctx, operation) + + default: + wait, err := w.Postgres.UndeleteBranch(ctx, undeleteBranchReq) + if err != nil { + return err + } + + // Show spinner while waiting for completion. + sp := cmdio.NewSpinner(ctx) + sp.Update("Waiting for undelete-branch to complete...") + + // Wait for completion. + opts := api.WithTimeout(undeleteBranchTimeout) + + err = wait.Wait(ctx, opts) + if err != nil { + return err + } + sp.Close() + return nil + } + } + + // Disable completions since they are not applicable. + // Can be overridden by manual implementation in `override.go`. + cmd.ValidArgsFunction = cobra.NoFileCompletions + + // Apply optional overrides to this command. + for _, fn := range undeleteBranchOverrides { + fn(cmd, &undeleteBranchReq) + } + + return cmd +} + // start undelete-project command // Slice with functions to override default command behavior. @@ -2708,8 +2816,10 @@ func newUndeleteProject() *cobra.Command { cmd.Flags().DurationVar(&undeleteProjectTimeout, "timeout", 0, `maximum amount of time to reach DONE state`) cmd.Use = "undelete-project NAME" - cmd.Short = `Undelete a Project.` - cmd.Long = `Undelete a Project. + cmd.Short = `*Beta* Undelete a Project.` + cmd.Long = `This command is in Beta and may change without notice. + +Undelete a Project. Undeletes a soft-deleted project. @@ -2722,12 +2832,9 @@ func newUndeleteProject() *cobra.Command { NAME: The full resource path of the project to undelete. Format: projects/{project_id}` - // This command is being previewed; hide from help output. - cmd.Hidden = true - cmd.Annotations = make(map[string]string) - cmd.Annotations["launch_stage"] = "PRIVATE_PREVIEW" - cmd.Annotations["launch_stage_display"] = "Private Preview" + cmd.Annotations["launch_stage"] = "PUBLIC_BETA" + cmd.Annotations["launch_stage_display"] = "Beta" cmd.Args = func(cmd *cobra.Command, args []string) error { check := root.ExactArgs(1) diff --git a/cmd/workspace/supervisor-agents/supervisor-agents.go b/cmd/workspace/supervisor-agents/supervisor-agents.go index afad5cbe5e0..b8a654de92a 100755 --- a/cmd/workspace/supervisor-agents/supervisor-agents.go +++ b/cmd/workspace/supervisor-agents/supervisor-agents.go @@ -287,8 +287,10 @@ Create a Tool. Creates a Tool under a Supervisor Agent. Specify one of "genie_space", "knowledge_assistant", "uc_function", "uc_connection", "app", "volume", - "lakeview_dashboard", "uc_table", "vector_search_index", "catalog", "schema", - "supervisor_agent", "web_search" in the request body. + "dashboard", "table", "vector_search_index", "catalog", "schema", + "supervisor_agent", "web_search" in the request body. The legacy values + "lakeview_dashboard" and "uc_table" are also accepted and remain equivalent to + "dashboard" and "table" respectively. Arguments: PARENT: Parent resource where this tool will be created. Format: @@ -296,9 +298,11 @@ Create a Tool. TOOL_ID: The ID to use for the tool, which will become the final component of the tool's resource name. TOOL_TYPE: Tool type. Must be one of: "genie_space", "knowledge_assistant", - "uc_function", "uc_connection", "app", "volume", "lakeview_dashboard", - "serving_endpoint", "uc_table", "vector_search_index", "catalog", - "schema", "supervisor_agent", "web_search".` + "uc_function", "uc_connection", "app", "volume", "dashboard", + "serving_endpoint", "table", "vector_search_index", "catalog", "schema", + "supervisor_agent", "web_search". The legacy values "lakeview_dashboard" + and "uc_table" are also accepted and remain equivalent to "dashboard" and + "table" respectively.` cmd.Annotations = make(map[string]string) cmd.Annotations["launch_stage"] = "PUBLIC_BETA" @@ -1484,9 +1488,11 @@ Update a Tool. supervisor-agents/{supervisor_agent_id}/tools/{tool_id} UPDATE_MASK: Field mask for fields to be updated. TOOL_TYPE: Tool type. Must be one of: "genie_space", "knowledge_assistant", - "uc_function", "uc_connection", "app", "volume", "lakeview_dashboard", - "serving_endpoint", "uc_table", "vector_search_index", "catalog", - "schema", "supervisor_agent", "web_search".` + "uc_function", "uc_connection", "app", "volume", "dashboard", + "serving_endpoint", "table", "vector_search_index", "catalog", "schema", + "supervisor_agent", "web_search". The legacy values "lakeview_dashboard" + and "uc_table" are also accepted and remain equivalent to "dashboard" and + "table" respectively.` cmd.Annotations = make(map[string]string) cmd.Annotations["launch_stage"] = "PUBLIC_BETA" diff --git a/cmd/workspace/temporary-path-credentials/temporary-path-credentials.go b/cmd/workspace/temporary-path-credentials/temporary-path-credentials.go index a6a77d6c72f..a8abcf57ad7 100755 --- a/cmd/workspace/temporary-path-credentials/temporary-path-credentials.go +++ b/cmd/workspace/temporary-path-credentials/temporary-path-credentials.go @@ -37,18 +37,16 @@ Temporary Path Credentials refer to short-lived, downscoped credentials used temporary path credentials API, a metastore admin needs to enable the external_access_enabled flag (off by default) at the metastore level. A user needs to be granted the EXTERNAL USE LOCATION permission by external location - owner. For requests on existing external tables, user also needs to be granted - the EXTERNAL USE SCHEMA permission at the schema level by catalog owner. + owner. For requests on existing external tables and external volumes, user + also needs to be granted the EXTERNAL USE SCHEMA permission at the schema + level by catalog owner. Note that EXTERNAL USE SCHEMA is a schema level permission that can only be granted by catalog owner explicitly and is not included in schema ownership or ALL PRIVILEGES on the schema for security reasons. Similarly, EXTERNAL USE LOCATION is an external location level permission that can only be granted by external location owner explicitly and is not included in external location - ownership or ALL PRIVILEGES on the external location for security reasons. - - This API only supports temporary path credentials for external locations and - external tables, and volumes will be supported in the future.`, + ownership or ALL PRIVILEGES on the external location for security reasons.`, GroupID: "catalog", RunE: root.ReportUnknownSubcommand, } diff --git a/cmd/workspace/temporary-volume-credentials/temporary-volume-credentials.go b/cmd/workspace/temporary-volume-credentials/temporary-volume-credentials.go index d3ed061d399..1afe54d31f5 100755 --- a/cmd/workspace/temporary-volume-credentials/temporary-volume-credentials.go +++ b/cmd/workspace/temporary-volume-credentials/temporary-volume-credentials.go @@ -18,8 +18,10 @@ var cmdOverrides []func(*cobra.Command) func New() *cobra.Command { cmd := &cobra.Command{ Use: "temporary-volume-credentials", - Short: `Temporary Volume Credentials refer to short-lived, downscoped credentials used to access cloud storage locations where volume data is stored in Databricks.`, - Long: `Temporary Volume Credentials refer to short-lived, downscoped credentials used + Short: `*Public Preview* Temporary Volume Credentials refer to short-lived, downscoped credentials used to access cloud storage locations where volume data is stored in Databricks.`, + Long: `This command is in Public Preview and may change without notice. + +Temporary Volume Credentials refer to short-lived, downscoped credentials used to access cloud storage locations where volume data is stored in Databricks. These credentials are employed to provide secure and time-limited access to data in cloud environments such as AWS, Azure, and Google Cloud. Each cloud @@ -37,15 +39,12 @@ func New() *cobra.Command { can only be granted by catalog owner explicitly and is not included in schema ownership or ALL PRIVILEGES on the schema for security reasons.`, GroupID: "catalog", - - // This service is being previewed; hide from help output. - Hidden: true, - RunE: root.ReportUnknownSubcommand, + RunE: root.ReportUnknownSubcommand, } cmd.Annotations = make(map[string]string) - cmd.Annotations["launch_stage"] = "PRIVATE_PREVIEW" - cmd.Annotations["launch_stage_display"] = "Private Preview" + cmd.Annotations["launch_stage"] = "PUBLIC_PREVIEW" + cmd.Annotations["launch_stage_display"] = "Public Preview" // Add methods cmd.AddCommand(newGenerateTemporaryVolumeCredentials()) @@ -79,8 +78,10 @@ func newGenerateTemporaryVolumeCredentials() *cobra.Command { cmd.Flags().StringVar(&generateTemporaryVolumeCredentialsReq.VolumeId, "volume-id", generateTemporaryVolumeCredentialsReq.VolumeId, `Id of the volume to read or write.`) cmd.Use = "generate-temporary-volume-credentials" - cmd.Short = `Generate a temporary volume credential.` - cmd.Long = `Generate a temporary volume credential. + cmd.Short = `*Public Preview* Generate a temporary volume credential.` + cmd.Long = `This command is in Public Preview and may change without notice. + +Generate a temporary volume credential. Get a short-lived credential for directly accessing the volume data on cloud storage. The metastore must have **external_access_enabled** flag set to true @@ -88,8 +89,8 @@ func newGenerateTemporaryVolumeCredentials() *cobra.Command { the parent schema and this privilege can only be granted by catalog owners.` cmd.Annotations = make(map[string]string) - cmd.Annotations["launch_stage"] = "PRIVATE_PREVIEW" - cmd.Annotations["launch_stage_display"] = "Private Preview" + cmd.Annotations["launch_stage"] = "PUBLIC_PREVIEW" + cmd.Annotations["launch_stage_display"] = "Public Preview" cmd.Args = func(cmd *cobra.Command, args []string) error { check := root.ExactArgs(0) diff --git a/cmd/workspace/vector-search-endpoints/vector-search-endpoints.go b/cmd/workspace/vector-search-endpoints/vector-search-endpoints.go index 455a61586ac..9342d2999d0 100755 --- a/cmd/workspace/vector-search-endpoints/vector-search-endpoints.go +++ b/cmd/workspace/vector-search-endpoints/vector-search-endpoints.go @@ -21,8 +21,8 @@ var cmdOverrides []func(*cobra.Command) func New() *cobra.Command { cmd := &cobra.Command{ Use: "vector-search-endpoints", - Short: `**Endpoint**: Represents the compute resources to host vector search indexes.`, - Long: `**Endpoint**: Represents the compute resources to host vector search indexes.`, + Short: `**Endpoint**: Represents the compute resources to host AI Search indexes.`, + Long: `**Endpoint**: Represents the compute resources to host AI Search indexes.`, GroupID: "vectorsearch", RunE: root.ReportUnknownSubcommand, } @@ -87,7 +87,7 @@ func newCreateEndpoint() *cobra.Command { Create a new endpoint. Arguments: - NAME: Name of the vector search endpoint + NAME: Name of the AI Search endpoint ENDPOINT_TYPE: Type of endpoint Supported values: [STANDARD, STORAGE_OPTIMIZED]` @@ -191,10 +191,10 @@ func newDeleteEndpoint() *cobra.Command { cmd.Short = `Delete an endpoint.` cmd.Long = `Delete an endpoint. - Delete a vector search endpoint. + Delete an AI Search endpoint. Arguments: - ENDPOINT_NAME: Name of the vector search endpoint` + ENDPOINT_NAME: Name of the AI Search endpoint` cmd.Annotations = make(map[string]string) cmd.Annotations["launch_stage"] = "GA" @@ -249,7 +249,7 @@ func newGetEndpoint() *cobra.Command { cmd.Short = `Get an endpoint.` cmd.Long = `Get an endpoint. - Get details for a single vector search endpoint. + Get details for a single AI Search endpoint. Arguments: ENDPOINT_NAME: Name of the endpoint` @@ -438,7 +438,7 @@ func newListEndpoints() *cobra.Command { cmd.Short = `List all endpoints.` cmd.Long = `List all endpoints. - List all vector search endpoints in the workspace.` + List all AI Search endpoints in the workspace.` cmd.Annotations = make(map[string]string) cmd.Annotations["launch_stage"] = "GA" @@ -505,7 +505,7 @@ Update an endpoint. Update an endpoint Arguments: - ENDPOINT_NAME: Name of the vector search endpoint` + ENDPOINT_NAME: Name of the AI Search endpoint` cmd.Annotations = make(map[string]string) cmd.Annotations["launch_stage"] = "PUBLIC_PREVIEW" @@ -585,7 +585,7 @@ func newRetrieveUserVisibleMetrics() *cobra.Command { Retrieve user-visible metrics for an endpoint Arguments: - NAME: Vector search endpoint name` + NAME: AI Search endpoint name` cmd.Annotations = make(map[string]string) cmd.Annotations["launch_stage"] = "GA" @@ -739,7 +739,7 @@ Update the budget policy of an endpoint. Update the budget policy of an endpoint Arguments: - ENDPOINT_NAME: Name of the vector search endpoint + ENDPOINT_NAME: Name of the AI Search endpoint BUDGET_POLICY_ID: The budget policy id to be applied` cmd.Annotations = make(map[string]string) @@ -822,7 +822,7 @@ func newUpdateEndpointCustomTags() *cobra.Command { cmd.Long = `Update the custom tags of an endpoint. Arguments: - ENDPOINT_NAME: Name of the vector search endpoint` + ENDPOINT_NAME: Name of the AI Search endpoint` // This command is being previewed; hide from help output. cmd.Hidden = true diff --git a/cmd/workspace/vector-search-indexes/vector-search-indexes.go b/cmd/workspace/vector-search-indexes/vector-search-indexes.go index 87dc851c222..53b5c250716 100755 --- a/cmd/workspace/vector-search-indexes/vector-search-indexes.go +++ b/cmd/workspace/vector-search-indexes/vector-search-indexes.go @@ -24,12 +24,12 @@ func New() *cobra.Command { Long: `**Index**: An efficient representation of your embedding vectors that supports real-time and efficient approximate nearest neighbor (ANN) search queries. - There are 2 types of Vector Search indexes: - **Delta Sync Index**: An index - that automatically syncs with a source Delta Table, automatically and - incrementally updating the index as the underlying data in the Delta Table - changes. - **Direct Vector Access Index**: An index that supports direct read - and write of vectors and metadata through our REST and SDK APIs. With this - model, the user manages index updates.`, + There are 2 types of AI Search indexes: - **Delta Sync Index**: An index that + automatically syncs with a source Delta Table, automatically and incrementally + updating the index as the underlying data in the Delta Table changes. - + **Direct Vector Access Index**: An index that supports direct read and write + of vectors and metadata through our REST and SDK APIs. With this model, the + user manages index updates.`, GroupID: "vectorsearch", RunE: root.ReportUnknownSubcommand, } diff --git a/cmd/workspace/workspace-iam-v2/workspace-iam-v2.go b/cmd/workspace/workspace-iam-v2/workspace-iam-v2.go index 48402a61c70..f46706976cf 100755 --- a/cmd/workspace/workspace-iam-v2/workspace-iam-v2.go +++ b/cmd/workspace/workspace-iam-v2/workspace-iam-v2.go @@ -4,11 +4,13 @@ package workspace_iam_v2 import ( "fmt" + "strings" "github.com/databricks/cli/cmd/root" "github.com/databricks/cli/libs/cmdctx" "github.com/databricks/cli/libs/cmdio" "github.com/databricks/cli/libs/flags" + "github.com/databricks/databricks-sdk-go/common/types/fieldmask" "github.com/databricks/databricks-sdk-go/service/iamv2" "github.com/spf13/cobra" ) @@ -34,10 +36,15 @@ These APIs are used to manage identities and the workspace access of these cmd.Annotations["launch_stage_display"] = "Beta" // Add methods + cmd.AddCommand(newCreateWorkspaceAssignmentDetailProxy()) + cmd.AddCommand(newDeleteWorkspaceAssignmentDetailProxy()) cmd.AddCommand(newGetWorkspaceAccessDetailLocal()) + cmd.AddCommand(newGetWorkspaceAssignmentDetailProxy()) + cmd.AddCommand(newListWorkspaceAssignmentDetailsProxy()) cmd.AddCommand(newResolveGroupProxy()) cmd.AddCommand(newResolveServicePrincipalProxy()) cmd.AddCommand(newResolveUserProxy()) + cmd.AddCommand(newUpdateWorkspaceAssignmentDetailProxy()) // Apply optional overrides to this command. for _, fn := range cmdOverrides { @@ -47,6 +54,173 @@ These APIs are used to manage identities and the workspace access of these return cmd } +// start create-workspace-assignment-detail-proxy command + +// Slice with functions to override default command behavior. +// Functions can be added from the `init()` function in manually curated files in this directory. +var createWorkspaceAssignmentDetailProxyOverrides []func( + *cobra.Command, + *iamv2.CreateWorkspaceAssignmentDetailProxyRequest, +) + +func newCreateWorkspaceAssignmentDetailProxy() *cobra.Command { + cmd := &cobra.Command{} + + var createWorkspaceAssignmentDetailProxyReq iamv2.CreateWorkspaceAssignmentDetailProxyRequest + createWorkspaceAssignmentDetailProxyReq.WorkspaceAssignmentDetail = iamv2.WorkspaceAssignmentDetail{} + var createWorkspaceAssignmentDetailProxyJson flags.JsonFlag + + cmd.Flags().Var(&createWorkspaceAssignmentDetailProxyJson, "json", `either inline JSON string or @path/to/file.json with request body`) + + // TODO: array: entitlements + + cmd.Use = "create-workspace-assignment-detail-proxy PRINCIPAL_ID" + cmd.Short = `Create a workspace assignment detail for a workspace.` + cmd.Long = `Create a workspace assignment detail for a workspace. + + Creates a workspace assignment detail for a principal (workspace-level proxy). + Entitlement grants are applied individually and non-atomically — if a + failure occurs partway through, the principal will be assigned to the + workspace but with only a subset of the requested entitlements. Use + GetWorkspaceAssignmentDetail to confirm which entitlements were successfully + granted. + + Arguments: + PRINCIPAL_ID: The internal ID of the principal (user/sp/group) in Databricks.` + + // This command is being previewed; hide from help output. + cmd.Hidden = true + + cmd.Annotations = make(map[string]string) + cmd.Annotations["launch_stage"] = "PRIVATE_PREVIEW" + cmd.Annotations["launch_stage_display"] = "Private Preview" + + cmd.Args = func(cmd *cobra.Command, args []string) error { + if cmd.Flags().Changed("json") { + err := root.ExactArgs(0)(cmd, args) + if err != nil { + return fmt.Errorf("when --json flag is specified, no positional arguments are allowed. Provide 'principal_id' in your JSON input") + } + return nil + } + check := root.ExactArgs(1) + return check(cmd, args) + } + + cmd.PreRunE = root.MustWorkspaceClient + cmd.RunE = func(cmd *cobra.Command, args []string) (err error) { + ctx := cmd.Context() + w := cmdctx.WorkspaceClient(ctx) + + if cmd.Flags().Changed("json") { + diags := createWorkspaceAssignmentDetailProxyJson.Unmarshal(&createWorkspaceAssignmentDetailProxyReq.WorkspaceAssignmentDetail) + if diags.HasError() { + return diags.Error() + } + if len(diags) > 0 { + err := cmdio.RenderDiagnostics(ctx, diags) + if err != nil { + return err + } + } + } + if !cmd.Flags().Changed("json") { + _, err = fmt.Sscan(args[0], &createWorkspaceAssignmentDetailProxyReq.WorkspaceAssignmentDetail.PrincipalId) + if err != nil { + return fmt.Errorf("invalid PRINCIPAL_ID: %s", args[0]) + } + + } + + response, err := w.WorkspaceIamV2.CreateWorkspaceAssignmentDetailProxy(ctx, createWorkspaceAssignmentDetailProxyReq) + if err != nil { + return err + } + + return cmdio.Render(ctx, response) + } + + // Disable completions since they are not applicable. + // Can be overridden by manual implementation in `override.go`. + cmd.ValidArgsFunction = cobra.NoFileCompletions + + // Apply optional overrides to this command. + for _, fn := range createWorkspaceAssignmentDetailProxyOverrides { + fn(cmd, &createWorkspaceAssignmentDetailProxyReq) + } + + return cmd +} + +// start delete-workspace-assignment-detail-proxy command + +// Slice with functions to override default command behavior. +// Functions can be added from the `init()` function in manually curated files in this directory. +var deleteWorkspaceAssignmentDetailProxyOverrides []func( + *cobra.Command, + *iamv2.DeleteWorkspaceAssignmentDetailProxyRequest, +) + +func newDeleteWorkspaceAssignmentDetailProxy() *cobra.Command { + cmd := &cobra.Command{} + + var deleteWorkspaceAssignmentDetailProxyReq iamv2.DeleteWorkspaceAssignmentDetailProxyRequest + + cmd.Use = "delete-workspace-assignment-detail-proxy PRINCIPAL_ID" + cmd.Short = `Delete a workspace assignment detail for a workspace.` + cmd.Long = `Delete a workspace assignment detail for a workspace. + + Deletes a workspace assignment detail for a principal (workspace-level proxy), + revoking all associated entitlements. Entitlement revocations are applied + individually and non-atomically — if a failure occurs partway through, the + principal remains assigned with a subset of its original entitlements, and the + operation is safe to retry. + + Arguments: + PRINCIPAL_ID: Required. ID of the principal in Databricks to delete workspace assignment + for.` + + // This command is being previewed; hide from help output. + cmd.Hidden = true + + cmd.Annotations = make(map[string]string) + cmd.Annotations["launch_stage"] = "PRIVATE_PREVIEW" + cmd.Annotations["launch_stage_display"] = "Private Preview" + + cmd.Args = func(cmd *cobra.Command, args []string) error { + check := root.ExactArgs(1) + return check(cmd, args) + } + + cmd.PreRunE = root.MustWorkspaceClient + cmd.RunE = func(cmd *cobra.Command, args []string) (err error) { + ctx := cmd.Context() + w := cmdctx.WorkspaceClient(ctx) + + _, err = fmt.Sscan(args[0], &deleteWorkspaceAssignmentDetailProxyReq.PrincipalId) + if err != nil { + return fmt.Errorf("invalid PRINCIPAL_ID: %s", args[0]) + } + + err = w.WorkspaceIamV2.DeleteWorkspaceAssignmentDetailProxy(ctx, deleteWorkspaceAssignmentDetailProxyReq) + if err != nil { + return err + } + return nil + } + + // Disable completions since they are not applicable. + // Can be overridden by manual implementation in `override.go`. + cmd.ValidArgsFunction = cobra.NoFileCompletions + + // Apply optional overrides to this command. + for _, fn := range deleteWorkspaceAssignmentDetailProxyOverrides { + fn(cmd, &deleteWorkspaceAssignmentDetailProxyReq) + } + + return cmd +} + // start get-workspace-access-detail-local command // Slice with functions to override default command behavior. @@ -119,6 +293,133 @@ Get workspace access details for a principal. return cmd } +// start get-workspace-assignment-detail-proxy command + +// Slice with functions to override default command behavior. +// Functions can be added from the `init()` function in manually curated files in this directory. +var getWorkspaceAssignmentDetailProxyOverrides []func( + *cobra.Command, + *iamv2.GetWorkspaceAssignmentDetailProxyRequest, +) + +func newGetWorkspaceAssignmentDetailProxy() *cobra.Command { + cmd := &cobra.Command{} + + var getWorkspaceAssignmentDetailProxyReq iamv2.GetWorkspaceAssignmentDetailProxyRequest + + cmd.Use = "get-workspace-assignment-detail-proxy PRINCIPAL_ID" + cmd.Short = `Get workspace assignment details for a principal.` + cmd.Long = `Get workspace assignment details for a principal. + + Returns the assignment details for a principal in a workspace (workspace-level + proxy). + + Arguments: + PRINCIPAL_ID: Required. The internal ID of the principal (user/sp/group) for which the + assignment details are being requested.` + + // This command is being previewed; hide from help output. + cmd.Hidden = true + + cmd.Annotations = make(map[string]string) + cmd.Annotations["launch_stage"] = "PRIVATE_PREVIEW" + cmd.Annotations["launch_stage_display"] = "Private Preview" + + cmd.Args = func(cmd *cobra.Command, args []string) error { + check := root.ExactArgs(1) + return check(cmd, args) + } + + cmd.PreRunE = root.MustWorkspaceClient + cmd.RunE = func(cmd *cobra.Command, args []string) (err error) { + ctx := cmd.Context() + w := cmdctx.WorkspaceClient(ctx) + + _, err = fmt.Sscan(args[0], &getWorkspaceAssignmentDetailProxyReq.PrincipalId) + if err != nil { + return fmt.Errorf("invalid PRINCIPAL_ID: %s", args[0]) + } + + response, err := w.WorkspaceIamV2.GetWorkspaceAssignmentDetailProxy(ctx, getWorkspaceAssignmentDetailProxyReq) + if err != nil { + return err + } + + return cmdio.Render(ctx, response) + } + + // Disable completions since they are not applicable. + // Can be overridden by manual implementation in `override.go`. + cmd.ValidArgsFunction = cobra.NoFileCompletions + + // Apply optional overrides to this command. + for _, fn := range getWorkspaceAssignmentDetailProxyOverrides { + fn(cmd, &getWorkspaceAssignmentDetailProxyReq) + } + + return cmd +} + +// start list-workspace-assignment-details-proxy command + +// Slice with functions to override default command behavior. +// Functions can be added from the `init()` function in manually curated files in this directory. +var listWorkspaceAssignmentDetailsProxyOverrides []func( + *cobra.Command, + *iamv2.ListWorkspaceAssignmentDetailsProxyRequest, +) + +func newListWorkspaceAssignmentDetailsProxy() *cobra.Command { + cmd := &cobra.Command{} + + var listWorkspaceAssignmentDetailsProxyReq iamv2.ListWorkspaceAssignmentDetailsProxyRequest + + cmd.Flags().IntVar(&listWorkspaceAssignmentDetailsProxyReq.PageSize, "page-size", listWorkspaceAssignmentDetailsProxyReq.PageSize, `The maximum number of workspace assignment details to return.`) + cmd.Flags().StringVar(&listWorkspaceAssignmentDetailsProxyReq.PageToken, "page-token", listWorkspaceAssignmentDetailsProxyReq.PageToken, `A page token, received from a previous ListWorkspaceAssignmentDetailsProxy call.`) + + cmd.Use = "list-workspace-assignment-details-proxy" + cmd.Short = `List workspace assignment details for a workspace.` + cmd.Long = `List workspace assignment details for a workspace. + + Lists workspace assignment details for a workspace (workspace-level proxy).` + + // This command is being previewed; hide from help output. + cmd.Hidden = true + + cmd.Annotations = make(map[string]string) + cmd.Annotations["launch_stage"] = "PRIVATE_PREVIEW" + cmd.Annotations["launch_stage_display"] = "Private Preview" + + cmd.Args = func(cmd *cobra.Command, args []string) error { + check := root.ExactArgs(0) + return check(cmd, args) + } + + cmd.PreRunE = root.MustWorkspaceClient + cmd.RunE = func(cmd *cobra.Command, args []string) (err error) { + ctx := cmd.Context() + w := cmdctx.WorkspaceClient(ctx) + + response, err := w.WorkspaceIamV2.ListWorkspaceAssignmentDetailsProxy(ctx, listWorkspaceAssignmentDetailsProxyReq) + if err != nil { + return err + } + + return cmdio.Render(ctx, response) + } + + // Disable completions since they are not applicable. + // Can be overridden by manual implementation in `override.go`. + cmd.ValidArgsFunction = cobra.NoFileCompletions + + // Apply optional overrides to this command. + for _, fn := range listWorkspaceAssignmentDetailsProxyOverrides { + fn(cmd, &listWorkspaceAssignmentDetailsProxyReq) + } + + return cmd +} + // start resolve-group-proxy command // Slice with functions to override default command behavior. @@ -381,4 +682,112 @@ Resolve an external user in the Databricks account. return cmd } +// start update-workspace-assignment-detail-proxy command + +// Slice with functions to override default command behavior. +// Functions can be added from the `init()` function in manually curated files in this directory. +var updateWorkspaceAssignmentDetailProxyOverrides []func( + *cobra.Command, + *iamv2.UpdateWorkspaceAssignmentDetailProxyRequest, +) + +func newUpdateWorkspaceAssignmentDetailProxy() *cobra.Command { + cmd := &cobra.Command{} + + var updateWorkspaceAssignmentDetailProxyReq iamv2.UpdateWorkspaceAssignmentDetailProxyRequest + updateWorkspaceAssignmentDetailProxyReq.WorkspaceAssignmentDetail = iamv2.WorkspaceAssignmentDetail{} + var updateWorkspaceAssignmentDetailProxyJson flags.JsonFlag + + cmd.Flags().Var(&updateWorkspaceAssignmentDetailProxyJson, "json", `either inline JSON string or @path/to/file.json with request body`) + + // TODO: array: entitlements + + cmd.Use = "update-workspace-assignment-detail-proxy PRINCIPAL_ID UPDATE_MASK PRINCIPAL_ID" + cmd.Short = `Update a workspace assignment detail for a workspace.` + cmd.Long = `Update a workspace assignment detail for a workspace. + + Updates the entitlements of a directly assigned principal in a workspace + (workspace-level proxy). Entitlement changes are applied individually and + non-atomically — if a failure occurs partway through, only a subset of the + requested changes may have been applied. Use GetWorkspaceAssignmentDetail to + confirm the final state. + + Arguments: + PRINCIPAL_ID: Required. ID of the principal in Databricks. + UPDATE_MASK: Required. The list of fields to update. + PRINCIPAL_ID: The internal ID of the principal (user/sp/group) in Databricks.` + + // This command is being previewed; hide from help output. + cmd.Hidden = true + + cmd.Annotations = make(map[string]string) + cmd.Annotations["launch_stage"] = "PRIVATE_PREVIEW" + cmd.Annotations["launch_stage_display"] = "Private Preview" + + cmd.Args = func(cmd *cobra.Command, args []string) error { + if cmd.Flags().Changed("json") { + err := root.ExactArgs(2)(cmd, args) + if err != nil { + return fmt.Errorf("when --json flag is specified, provide only PRINCIPAL_ID, UPDATE_MASK as positional arguments. Provide 'principal_id' in your JSON input") + } + return nil + } + check := root.ExactArgs(3) + return check(cmd, args) + } + + cmd.PreRunE = root.MustWorkspaceClient + cmd.RunE = func(cmd *cobra.Command, args []string) (err error) { + ctx := cmd.Context() + w := cmdctx.WorkspaceClient(ctx) + + if cmd.Flags().Changed("json") { + diags := updateWorkspaceAssignmentDetailProxyJson.Unmarshal(&updateWorkspaceAssignmentDetailProxyReq.WorkspaceAssignmentDetail) + if diags.HasError() { + return diags.Error() + } + if len(diags) > 0 { + err := cmdio.RenderDiagnostics(ctx, diags) + if err != nil { + return err + } + } + } + _, err = fmt.Sscan(args[0], &updateWorkspaceAssignmentDetailProxyReq.PrincipalId) + if err != nil { + return fmt.Errorf("invalid PRINCIPAL_ID: %s", args[0]) + } + + if args[1] != "" { + updateMaskArray := strings.Split(args[1], ",") + updateWorkspaceAssignmentDetailProxyReq.UpdateMask = *fieldmask.New(updateMaskArray) + } + if !cmd.Flags().Changed("json") { + _, err = fmt.Sscan(args[2], &updateWorkspaceAssignmentDetailProxyReq.WorkspaceAssignmentDetail.PrincipalId) + if err != nil { + return fmt.Errorf("invalid PRINCIPAL_ID: %s", args[2]) + } + + } + + response, err := w.WorkspaceIamV2.UpdateWorkspaceAssignmentDetailProxy(ctx, updateWorkspaceAssignmentDetailProxyReq) + if err != nil { + return err + } + + return cmdio.Render(ctx, response) + } + + // Disable completions since they are not applicable. + // Can be overridden by manual implementation in `override.go`. + cmd.ValidArgsFunction = cobra.NoFileCompletions + + // Apply optional overrides to this command. + for _, fn := range updateWorkspaceAssignmentDetailProxyOverrides { + fn(cmd, &updateWorkspaceAssignmentDetailProxyReq) + } + + return cmd +} + // end service WorkspaceIamV2 diff --git a/cmd/workspace/workspace-settings-v2/workspace-settings-v2.go b/cmd/workspace/workspace-settings-v2/workspace-settings-v2.go index 114b97882e0..64ceb60cedc 100755 --- a/cmd/workspace/workspace-settings-v2/workspace-settings-v2.go +++ b/cmd/workspace/workspace-settings-v2/workspace-settings-v2.go @@ -202,18 +202,22 @@ func newPatchPublicWorkspaceSetting() *cobra.Command { // TODO: complex arg: aibi_dashboard_embedding_access_policy // TODO: complex arg: aibi_dashboard_embedding_approved_domains + // TODO: complex arg: allowed_apps_user_api_scopes // TODO: complex arg: automatic_cluster_update_workspace // TODO: complex arg: boolean_val // TODO: complex arg: effective_aibi_dashboard_embedding_access_policy // TODO: complex arg: effective_aibi_dashboard_embedding_approved_domains + // TODO: complex arg: effective_allowed_apps_user_api_scopes // TODO: complex arg: effective_automatic_cluster_update_workspace // TODO: complex arg: effective_boolean_val // TODO: complex arg: effective_integer_val + // TODO: complex arg: effective_operational_email_custom_recipient // TODO: complex arg: effective_personal_compute // TODO: complex arg: effective_restrict_workspace_admins // TODO: complex arg: effective_string_val // TODO: complex arg: integer_val cmd.Flags().StringVar(&patchPublicWorkspaceSettingReq.Setting.Name, "name", patchPublicWorkspaceSettingReq.Setting.Name, `Name of the setting.`) + // TODO: complex arg: operational_email_custom_recipient // TODO: complex arg: personal_compute // TODO: complex arg: restrict_workspace_admins // TODO: complex arg: string_val diff --git a/experimental/postgres/cmd/targeting.go b/experimental/postgres/cmd/targeting.go index 6d04055cb22..cf1290ad578 100644 --- a/experimental/postgres/cmd/targeting.go +++ b/experimental/postgres/cmd/targeting.go @@ -9,6 +9,7 @@ import ( "github.com/databricks/cli/libs/cmdctx" "github.com/databricks/databricks-sdk-go" "github.com/databricks/databricks-sdk-go/service/database" + "github.com/databricks/databricks-sdk-go/service/iam" "github.com/databricks/databricks-sdk-go/service/postgres" ) @@ -113,7 +114,7 @@ func resolveProvisioned(ctx context.Context, w *databricks.WorkspaceClient, inst return nil, fmt.Errorf("database instance %q is not ready for accepting connections (state: %s)", instance.Name, instance.State) } - user, err := w.CurrentUser.Me(ctx) + user, err := w.CurrentUser.Me(ctx, iam.MeRequest{}) if err != nil { return nil, fmt.Errorf("failed to get current user: %w", err) } @@ -174,7 +175,7 @@ func resolveAutoscaling(ctx context.Context, w *databricks.WorkspaceClient, spec return nil, err } - user, err := w.CurrentUser.Me(ctx) + user, err := w.CurrentUser.Me(ctx, iam.MeRequest{}) if err != nil { return nil, fmt.Errorf("failed to get current user: %w", err) } diff --git a/experimental/ssh/internal/client/client.go b/experimental/ssh/internal/client/client.go index 5ab096d2929..69360b85d12 100644 --- a/experimental/ssh/internal/client/client.go +++ b/experimental/ssh/internal/client/client.go @@ -31,6 +31,7 @@ import ( "github.com/databricks/databricks-sdk-go" "github.com/databricks/databricks-sdk-go/retries" "github.com/databricks/databricks-sdk-go/service/compute" + "github.com/databricks/databricks-sdk-go/service/iam" "github.com/databricks/databricks-sdk-go/service/jobs" "github.com/databricks/databricks-sdk-go/service/workspace" "github.com/gorilla/websocket" @@ -370,7 +371,7 @@ func runIDE(ctx context.Context, client *databricks.WorkspaceClient, userName, k } // Get Databricks user name for the workspace path - currentUser, err := client.CurrentUser.Me(ctx) + currentUser, err := client.CurrentUser.Me(ctx, iam.MeRequest{}) if err != nil { return fmt.Errorf("failed to get current user: %w", err) } diff --git a/experimental/ssh/internal/keys/secrets.go b/experimental/ssh/internal/keys/secrets.go index 76d44da5387..6409770a4d7 100644 --- a/experimental/ssh/internal/keys/secrets.go +++ b/experimental/ssh/internal/keys/secrets.go @@ -7,13 +7,14 @@ import ( "fmt" "github.com/databricks/databricks-sdk-go" + "github.com/databricks/databricks-sdk-go/service/iam" "github.com/databricks/databricks-sdk-go/service/workspace" ) // CreateKeysSecretScope creates or retrieves the secret scope for SSH keys. // sessionID is the unique identifier for the session (cluster ID for dedicated clusters, connection name for serverless). func CreateKeysSecretScope(ctx context.Context, client *databricks.WorkspaceClient, sessionID string) (string, error) { - me, err := client.CurrentUser.Me(ctx) + me, err := client.CurrentUser.Me(ctx, iam.MeRequest{}) if err != nil { return "", fmt.Errorf("failed to get current user: %w", err) } diff --git a/experimental/ssh/internal/workspace/workspace.go b/experimental/ssh/internal/workspace/workspace.go index 2f017cbae12..0a28b684ebc 100644 --- a/experimental/ssh/internal/workspace/workspace.go +++ b/experimental/ssh/internal/workspace/workspace.go @@ -10,6 +10,7 @@ import ( "github.com/databricks/cli/libs/filer" "github.com/databricks/databricks-sdk-go" + "github.com/databricks/databricks-sdk-go/service/iam" ) const metadataFileName = "metadata.json" @@ -21,7 +22,7 @@ type WorkspaceMetadata struct { } func getWorkspaceRootDir(ctx context.Context, client *databricks.WorkspaceClient) (string, error) { - me, err := client.CurrentUser.Me(ctx) + me, err := client.CurrentUser.Me(ctx, iam.MeRequest{}) if err != nil { return "", fmt.Errorf("failed to get current user: %w", err) } diff --git a/go.mod b/go.mod index 0bb3109463e..dbe3a55659f 100644 --- a/go.mod +++ b/go.mod @@ -13,7 +13,7 @@ require ( github.com/charmbracelet/huh v1.0.0 // MIT github.com/charmbracelet/lipgloss v1.1.0 // MIT github.com/charmbracelet/x/ansi v0.11.6 // MIT - github.com/databricks/databricks-sdk-go v0.132.0 // Apache-2.0 + github.com/databricks/databricks-sdk-go v0.136.0 // Apache-2.0 github.com/google/jsonschema-go v0.4.3 // MIT github.com/google/uuid v1.6.0 // BSD-3-Clause github.com/gorilla/websocket v1.5.3 // BSD-2-Clause diff --git a/go.sum b/go.sum index b89ad220399..cb7bd44ee92 100644 --- a/go.sum +++ b/go.sum @@ -71,8 +71,8 @@ github.com/cyphar/filepath-securejoin v0.4.1 h1:JyxxyPEaktOD+GAnqIqTf9A8tHyAG22r github.com/cyphar/filepath-securejoin v0.4.1/go.mod h1:Sdj7gXlvMcPZsbhwhQ33GguGLDGQL7h7bg04C/+u9jI= github.com/danieljoos/wincred v1.2.3 h1:v7dZC2x32Ut3nEfRH+vhoZGvN72+dQ/snVXo/vMFLdQ= github.com/danieljoos/wincred v1.2.3/go.mod h1:6qqX0WNrS4RzPZ1tnroDzq9kY3fu1KwE7MRLQK4X0bs= -github.com/databricks/databricks-sdk-go v0.132.0 h1:NuwAMg7aSlMinINIv4iJDDGge426QptIOi2N6RC/k3k= -github.com/databricks/databricks-sdk-go v0.132.0/go.mod h1:C5LNgGe6hGuRrTwoxFmuup3XtQQEaqtq0e+K8IFDIS4= +github.com/databricks/databricks-sdk-go v0.136.0 h1:7TF+fDS9jpwBqnVy0foZ/ej7zL0h1EezuHfYxGYvhNE= +github.com/databricks/databricks-sdk-go v0.136.0/go.mod h1:C5LNgGe6hGuRrTwoxFmuup3XtQQEaqtq0e+K8IFDIS4= github.com/davecgh/go-spew v1.1.0/go.mod h1:J7Y8YcW2NihsgmVo/mv3lAwl/skON4iLHjSsI+c5H38= github.com/davecgh/go-spew v1.1.1 h1:vj9j/u1bqnvCEfJOwUhtlOARqs3+rkHYY13jYWTU97c= github.com/davecgh/go-spew v1.1.1/go.mod h1:J7Y8YcW2NihsgmVo/mv3lAwl/skON4iLHjSsI+c5H38= diff --git a/integration/bundle/init_test.go b/integration/bundle/init_test.go index 6bec010f7b1..ff8b7de2c87 100644 --- a/integration/bundle/init_test.go +++ b/integration/bundle/init_test.go @@ -10,6 +10,7 @@ import ( "github.com/databricks/cli/internal/testcli" "github.com/databricks/cli/internal/testutil" "github.com/databricks/cli/libs/iamutil" + "github.com/databricks/databricks-sdk-go/service/iam" "github.com/stretchr/testify/assert" "github.com/stretchr/testify/require" ) @@ -25,7 +26,7 @@ func TestBundleInitHelpers(t *testing.T) { ctx, wt := acc.WorkspaceTest(t) w := wt.W - me, err := w.CurrentUser.Me(ctx) + me, err := w.CurrentUser.Me(ctx, iam.MeRequest{}) require.NoError(t, err) var smallestNode string diff --git a/integration/cmd/auth/describe_test.go b/integration/cmd/auth/describe_test.go index 1ea843b6b93..49796b892a3 100644 --- a/integration/cmd/auth/describe_test.go +++ b/integration/cmd/auth/describe_test.go @@ -9,6 +9,7 @@ import ( "github.com/databricks/cli/internal/testutil" "github.com/databricks/cli/libs/databrickscfg" "github.com/databricks/databricks-sdk-go/config" + "github.com/databricks/databricks-sdk-go/service/iam" "github.com/databricks/cli/internal/testcli" "github.com/databricks/databricks-sdk-go" @@ -28,7 +29,7 @@ func TestAuthDescribeSuccess(t *testing.T) { hostWithoutPrefix := strings.TrimPrefix(w.Config.Host, "https://") require.Regexp(t, "Host: (?:https://)?"+regexp.QuoteMeta(hostWithoutPrefix), outStr) - me, err := w.CurrentUser.Me(t.Context()) + me, err := w.CurrentUser.Me(t.Context(), iam.MeRequest{}) require.NoError(t, err) require.Contains(t, outStr, "User: "+me.UserName) require.Contains(t, outStr, "Authenticated with: "+w.Config.AuthType) diff --git a/integration/cmd/sync/sync_test.go b/integration/cmd/sync/sync_test.go index 5871c41db24..49853099582 100644 --- a/integration/cmd/sync/sync_test.go +++ b/integration/cmd/sync/sync_test.go @@ -23,6 +23,7 @@ import ( "github.com/databricks/cli/libs/testfile" "github.com/databricks/databricks-sdk-go" "github.com/databricks/databricks-sdk-go/client" + "github.com/databricks/databricks-sdk-go/service/iam" "github.com/databricks/databricks-sdk-go/service/workspace" "github.com/stretchr/testify/assert" "github.com/stretchr/testify/require" @@ -36,7 +37,7 @@ var ( // This test needs auth env vars to run. // Please run using the deco env test or deco env shell func setupRepo(t *testing.T, wsc *databricks.WorkspaceClient, ctx context.Context) (localRoot, remoteRoot string) { - me, err := wsc.CurrentUser.Me(ctx) + me, err := wsc.CurrentUser.Me(ctx, iam.MeRequest{}) require.NoError(t, err) repoPath := fmt.Sprintf("/Repos/%s/%s", me.UserName, testutil.RandomName("empty-repo-sync-integration-")) @@ -487,7 +488,7 @@ func TestSyncEnsureRemotePathIsUsableIfRepoDoesntExist(t *testing.T) { ctx, wt := acc.WorkspaceTest(t) wsc := wt.W - me, err := wsc.CurrentUser.Me(ctx) + me, err := wsc.CurrentUser.Me(ctx, iam.MeRequest{}) require.NoError(t, err) // Hypothetical repo path doesn't exist. @@ -526,7 +527,7 @@ func TestSyncEnsureRemotePathIsUsableInWorkspace(t *testing.T) { ctx, wt := acc.WorkspaceTest(t) wsc := wt.W - me, err := wsc.CurrentUser.Me(ctx) + me, err := wsc.CurrentUser.Me(ctx, iam.MeRequest{}) require.NoError(t, err) remotePath := fmt.Sprintf("/Users/%s/%s", me.UserName, testutil.RandomName("ensure-path-exists-test-")) diff --git a/integration/internal/acc/fixtures.go b/integration/internal/acc/fixtures.go index d902d0b49a1..8d61a9d35da 100644 --- a/integration/internal/acc/fixtures.go +++ b/integration/internal/acc/fixtures.go @@ -8,13 +8,14 @@ import ( "github.com/databricks/databricks-sdk-go/apierr" "github.com/databricks/databricks-sdk-go/service/catalog" "github.com/databricks/databricks-sdk-go/service/files" + "github.com/databricks/databricks-sdk-go/service/iam" "github.com/databricks/databricks-sdk-go/service/workspace" "github.com/stretchr/testify/require" ) func TemporaryWorkspaceDir(t *WorkspaceT, name ...string) string { ctx := t.ctx - me, err := t.W.CurrentUser.Me(ctx) + me, err := t.W.CurrentUser.Me(ctx, iam.MeRequest{}) require.NoError(t, err) // Prefix the name with "integration-test-" to make it easier to identify. @@ -69,7 +70,7 @@ func TemporaryDbfsDir(t *WorkspaceT, name ...string) string { func TemporaryRepo(t *WorkspaceT, url string) string { ctx := t.ctx - me, err := t.W.CurrentUser.Me(ctx) + me, err := t.W.CurrentUser.Me(ctx, iam.MeRequest{}) require.NoError(t, err) // Prefix the path with "integration-test-" to make it easier to identify. diff --git a/internal/genkit/tagging.py b/internal/genkit/tagging.py old mode 100644 new mode 100755 index 021e730be07..a3897bbeedf --- a/internal/genkit/tagging.py +++ b/internal/genkit/tagging.py @@ -443,6 +443,18 @@ def get_previous_tag_info(package: Package) -> Optional[TagInfo]: return TagInfo(package=package, version=version, content=latest_release) +def _load_codegen_config() -> Dict: + """ + Loads ``.codegen.json`` from the repo root. Returns an empty dict when + the file is missing. + """ + package_file_path = os.path.join(os.getcwd(), CODEGEN_FILE_NAME) + if not os.path.exists(package_file_path): + return {} + with open(package_file_path, "r") as file: + return json.load(file) + + def get_next_tag_info(package: Package) -> Optional[TagInfo]: """ Extracts the changes from the "NEXT_CHANGELOG.md" file. @@ -461,7 +473,11 @@ def get_next_tag_info(package: Package) -> Optional[TagInfo]: # Ensure there is exactly one empty line before each section next_changelog = re.sub(r"(\n*)(###[^\n]+)", r"\n\n\2", next_changelog) - if not re.search(r"###", next_changelog): + # By default, packages whose NEXT_CHANGELOG.md has no populated + # sections are skipped — there's nothing meaningful to release. + # Repos like sdk-js which are still in development can opt in + # by setting ``allow_empty_changelog: true`` in .codegen.json. + if not re.search(r"###", next_changelog) and not _load_codegen_config().get("allow_empty_changelog", False): print("All sections are empty. No changes will be made to the changelog.") return None @@ -709,11 +725,11 @@ def generate_commit_message(tag_infos: List[TagInfo]) -> str: raise Exception("Multiple packages found in legacy mode") return f"[Release] Release v{info.version}\n\n{info.content}" - # Sort tag_infos by package name for consistency + # Sort tag_infos by package name for consistency. tag_infos.sort(key=lambda info: info.package.name) - return "Release\n\n" + "\n\n".join( - f"## {info.package.name}/v{info.version}\n\n{info.content}" for info in tag_infos - ) + titles = ", ".join(f"{info.package.name}/v{info.version}" for info in tag_infos) + body = "\n\n".join(f"## {info.package.name}/v{info.version}\n\n{info.content}" for info in tag_infos) + return f"[Release] {titles}\n\n{body}" def push_changes(tag_infos: List[TagInfo]) -> None: @@ -816,10 +832,82 @@ def preview_tag_infos(packages: List[Package]) -> List[TagInfo]: return [info for info in (get_next_tag_info(package) for package in packages) if info is not None] +def order_tag_infos_by_dependency(tag_infos: List[TagInfo]) -> List[TagInfo]: + """ + Returns ``tag_infos`` in topological order: every package appears + after every sibling it depends on. + """ + if not tag_infos: + return list(tag_infos) + + if any(not info.package.name for info in tag_infos) and len(tag_infos) > 1: + raise Exception("Multiple packages found in legacy mode") + + package_file_path = os.path.join(os.getcwd(), CODEGEN_FILE_NAME) + with open(package_file_path, "r") as file: + codegen = json.load(file) + + name_template = codegen.get("dependency_name_template", "") + dep_patterns = codegen.get("dependency_pattern", {}) + if not name_template or not dep_patterns: + return list(tag_infos) + + by_dep_name: Dict[str, TagInfo] = { + name_template.replace("$PACKAGE", info.package.name): info for info in tag_infos if info.package.name + } + + # Adjacency: path -> set of paths it depends on (within tag_infos). + deps: Dict[str, set] = {info.package.path: set() for info in tag_infos} + for info in tag_infos: + for filename, pattern in dep_patterns.items(): + loc = os.path.join(os.getcwd(), info.package.path, filename) + if not os.path.exists(loc): + continue + with open(loc, "r") as f: + content = f.read() + for dep_name, dep_info in by_dep_name.items(): + if dep_info.package.path == info.package.path: + continue + regex = ( + re.escape(pattern) + .replace(re.escape("$DEPENDENCY"), re.escape(dep_name)) + .replace(re.escape("$VERSION"), Version.PATTERN) + ) + if re.search(regex, content): + deps[info.package.path].add(dep_info.package.path) + + # Stable topological sort: at each step, emit every node whose deps + # are already emitted, alphabetically by package name. Ties broken + # alphabetically so the manifest is reproducible across runs. + emitted: set = set() + ordered: List[TagInfo] = [] + while len(ordered) < len(tag_infos): + ready = sorted( + ( + info + for info in tag_infos + if info.package.path not in emitted and deps[info.package.path].issubset(emitted) + ), + key=lambda info: info.package.name, + ) + if not ready: + remaining = [info.package.name for info in tag_infos if info.package.path not in emitted] + raise Exception(f"Cyclic dependency detected among packages: {remaining}") + for info in ready: + ordered.append(info) + emitted.add(info.package.path) + return ordered + + def push_tags(tag_infos: List[TagInfo]) -> None: """ Creates and pushes tags to the repository. + Tags are emitted in topological order — dependencies before + dependents — so downstream publishing pipelines reading + ``created_tags.json`` can walk it sequentially without re-deriving + the dependency graph. See ``order_tag_infos_by_dependency``. + As a side effect, writes the names of successfully created tags to ``./created_tags.json`` so that workflows triggering this script can discover what was produced (the GitHub Actions workflow uploads this @@ -833,6 +921,7 @@ def push_tags(tag_infos: List[TagInfo]) -> None: exception is re-raised, so recovery-mode runs still surface their output. """ + tag_infos = order_tag_infos_by_dependency(tag_infos) created: List[str] = [] try: for tag_info in tag_infos: diff --git a/internal/genkit/tagging.py.lock b/internal/genkit/tagging.py.lock index d680b187f5b..2bd746a66c2 100644 --- a/internal/genkit/tagging.py.lock +++ b/internal/genkit/tagging.py.lock @@ -12,7 +12,7 @@ requirements = [ [[package]] name = "certifi" version = "2026.2.25" -source = { registry = "https://pypi-proxy.dev.databricks.com/simple/" } +source = { registry = "https://pypi-proxy.cloud.databricks.com/simple/" } sdist = { url = "https://files.pythonhosted.org/packages/af/2d/7bf41579a8986e348fa033a31cdd0e4121114f6bce2457e8876010b092dd/certifi-2026.2.25.tar.gz", hash = "sha256:e887ab5cee78ea814d3472169153c2d12cd43b14bd03329a39a9c6e2e80bfba7", size = 155029, upload-time = "2026-02-25T02:54:17.342Z" } wheels = [ { url = "https://files.pythonhosted.org/packages/9a/3c/c17fb3ca2d9c3acff52e30b309f538586f9f5b9c9cf454f3845fc9af4881/certifi-2026.2.25-py3-none-any.whl", hash = "sha256:027692e4402ad994f1c42e52a4997a9763c646b73e4096e4d5d6db8af1d6f0fa", size = 153684, upload-time = "2026-02-25T02:54:15.766Z" }, @@ -21,7 +21,7 @@ wheels = [ [[package]] name = "cffi" version = "2.0.0" -source = { registry = "https://pypi-proxy.dev.databricks.com/simple/" } +source = { registry = "https://pypi-proxy.cloud.databricks.com/simple/" } dependencies = [ { name = "pycparser", marker = "implementation_name != 'PyPy'" }, ] @@ -78,7 +78,7 @@ wheels = [ [[package]] name = "charset-normalizer" version = "3.4.5" -source = { registry = "https://pypi-proxy.dev.databricks.com/simple/" } +source = { registry = "https://pypi-proxy.cloud.databricks.com/simple/" } sdist = { url = "https://files.pythonhosted.org/packages/1d/35/02daf95b9cd686320bb622eb148792655c9412dbb9b67abb5694e5910a24/charset_normalizer-3.4.5.tar.gz", hash = "sha256:95adae7b6c42a6c5b5b559b1a99149f090a57128155daeea91732c8d970d8644", size = 134804, upload-time = "2026-03-06T06:03:19.46Z" } wheels = [ { url = "https://files.pythonhosted.org/packages/9c/b6/9ee9c1a608916ca5feae81a344dffbaa53b26b90be58cc2159e3332d44ec/charset_normalizer-3.4.5-cp312-cp312-macosx_10_13_universal2.whl", hash = "sha256:ed97c282ee4f994ef814042423a529df9497e3c666dca19be1d4cd1129dc7ade", size = 280976, upload-time = "2026-03-06T06:01:15.276Z" }, @@ -135,7 +135,7 @@ wheels = [ [[package]] name = "cryptography" version = "46.0.5" -source = { registry = "https://pypi-proxy.dev.databricks.com/simple/" } +source = { registry = "https://pypi-proxy.cloud.databricks.com/simple/" } dependencies = [ { name = "cffi", marker = "platform_python_implementation != 'PyPy'" }, ] @@ -188,7 +188,7 @@ wheels = [ [[package]] name = "idna" version = "3.11" -source = { registry = "https://pypi-proxy.dev.databricks.com/simple/" } +source = { registry = "https://pypi-proxy.cloud.databricks.com/simple/" } sdist = { url = "https://files.pythonhosted.org/packages/6f/6d/0703ccc57f3a7233505399edb88de3cbd678da106337b9fcde432b65ed60/idna-3.11.tar.gz", hash = "sha256:795dafcc9c04ed0c1fb032c2aa73654d8e8c5023a7df64a53f39190ada629902", size = 194582, upload-time = "2025-10-12T14:55:20.501Z" } wheels = [ { url = "https://files.pythonhosted.org/packages/0e/61/66938bbb5fc52dbdf84594873d5b51fb1f7c7794e9c0f5bd885f30bc507b/idna-3.11-py3-none-any.whl", hash = "sha256:771a87f49d9defaf64091e6e6fe9c18d4833f140bd19464795bc32d966ca37ea", size = 71008, upload-time = "2025-10-12T14:55:18.883Z" }, @@ -197,7 +197,7 @@ wheels = [ [[package]] name = "pycparser" version = "3.0" -source = { registry = "https://pypi-proxy.dev.databricks.com/simple/" } +source = { registry = "https://pypi-proxy.cloud.databricks.com/simple/" } sdist = { url = "https://files.pythonhosted.org/packages/1b/7d/92392ff7815c21062bea51aa7b87d45576f649f16458d78b7cf94b9ab2e6/pycparser-3.0.tar.gz", hash = "sha256:600f49d217304a5902ac3c37e1281c9fe94e4d0489de643a9504c5cdfdfc6b29", size = 103492, upload-time = "2026-01-21T14:26:51.89Z" } wheels = [ { url = "https://files.pythonhosted.org/packages/0c/c3/44f3fbbfa403ea2a7c779186dc20772604442dde72947e7d01069cbe98e3/pycparser-3.0-py3-none-any.whl", hash = "sha256:b727414169a36b7d524c1c3e31839a521725078d7b2ff038656844266160a992", size = 48172, upload-time = "2026-01-21T14:26:50.693Z" }, @@ -206,7 +206,7 @@ wheels = [ [[package]] name = "pygithub" version = "2.8.1" -source = { registry = "https://pypi-proxy.dev.databricks.com/simple/" } +source = { registry = "https://pypi-proxy.cloud.databricks.com/simple/" } dependencies = [ { name = "pyjwt", extra = ["crypto"] }, { name = "pynacl" }, @@ -222,7 +222,7 @@ wheels = [ [[package]] name = "pyjwt" version = "2.11.0" -source = { registry = "https://pypi-proxy.dev.databricks.com/simple/" } +source = { registry = "https://pypi-proxy.cloud.databricks.com/simple/" } sdist = { url = "https://files.pythonhosted.org/packages/5c/5a/b46fa56bf322901eee5b0454a34343cdbdae202cd421775a8ee4e42fd519/pyjwt-2.11.0.tar.gz", hash = "sha256:35f95c1f0fbe5d5ba6e43f00271c275f7a1a4db1dab27bf708073b75318ea623", size = 98019, upload-time = "2026-01-30T19:59:55.694Z" } wheels = [ { url = "https://files.pythonhosted.org/packages/6f/01/c26ce75ba460d5cd503da9e13b21a33804d38c2165dec7b716d06b13010c/pyjwt-2.11.0-py3-none-any.whl", hash = "sha256:94a6bde30eb5c8e04fee991062b534071fd1439ef58d2adc9ccb823e7bcd0469", size = 28224, upload-time = "2026-01-30T19:59:54.539Z" }, @@ -236,7 +236,7 @@ crypto = [ [[package]] name = "pynacl" version = "1.6.2" -source = { registry = "https://pypi-proxy.dev.databricks.com/simple/" } +source = { registry = "https://pypi-proxy.cloud.databricks.com/simple/" } dependencies = [ { name = "cffi", marker = "platform_python_implementation != 'PyPy'" }, ] @@ -271,7 +271,7 @@ wheels = [ [[package]] name = "requests" version = "2.32.5" -source = { registry = "https://pypi-proxy.dev.databricks.com/simple/" } +source = { registry = "https://pypi-proxy.cloud.databricks.com/simple/" } dependencies = [ { name = "certifi" }, { name = "charset-normalizer" }, @@ -286,7 +286,7 @@ wheels = [ [[package]] name = "typing-extensions" version = "4.15.0" -source = { registry = "https://pypi-proxy.dev.databricks.com/simple/" } +source = { registry = "https://pypi-proxy.cloud.databricks.com/simple/" } sdist = { url = "https://files.pythonhosted.org/packages/72/94/1a15dd82efb362ac84269196e94cf00f187f7ed21c242792a923cdb1c61f/typing_extensions-4.15.0.tar.gz", hash = "sha256:0cea48d173cc12fa28ecabc3b837ea3cf6f38c6d1136f85cbaaf598984861466", size = 109391, upload-time = "2025-08-25T13:49:26.313Z" } wheels = [ { url = "https://files.pythonhosted.org/packages/18/67/36e9267722cc04a6b9f15c7f3441c2363321a3ea07da7ae0c0707beb2a9c/typing_extensions-4.15.0-py3-none-any.whl", hash = "sha256:f0fa19c6845758ab08074a0cfa8b7aecb71c999ca73d62883bc25cc018c4e548", size = 44614, upload-time = "2025-08-25T13:49:24.86Z" }, @@ -295,7 +295,7 @@ wheels = [ [[package]] name = "urllib3" version = "2.6.3" -source = { registry = "https://pypi-proxy.dev.databricks.com/simple/" } +source = { registry = "https://pypi-proxy.cloud.databricks.com/simple/" } sdist = { url = "https://files.pythonhosted.org/packages/c7/24/5f1b3bdffd70275f6661c76461e25f024d5a38a46f04aaca912426a2b1d3/urllib3-2.6.3.tar.gz", hash = "sha256:1b62b6884944a57dbe321509ab94fd4d3b307075e0c2eae991ac71ee15ad38ed", size = 435556, upload-time = "2026-01-07T16:24:43.925Z" } wheels = [ { url = "https://files.pythonhosted.org/packages/39/08/aaaad47bc4e9dc8c725e68f9d04865dbcb2052843ff09c97b08904852d84/urllib3-2.6.3-py3-none-any.whl", hash = "sha256:bf272323e553dfb2e87d9bfd225ca7b0f467b919d7bbd355436d3fd37cb0acd4", size = 131584, upload-time = "2026-01-07T16:24:42.685Z" }, diff --git a/libs/databrickscfg/cfgpickers/clusters.go b/libs/databrickscfg/cfgpickers/clusters.go index 4d6aba6b18a..f01f567007a 100644 --- a/libs/databrickscfg/cfgpickers/clusters.go +++ b/libs/databrickscfg/cfgpickers/clusters.go @@ -140,7 +140,7 @@ func loadInteractiveClusters(ctx context.Context, w *databricks.WorkspaceClient, if err != nil { return nil, fmt.Errorf("list clusters: %w", err) } - me, err := w.CurrentUser.Me(ctx) + me, err := w.CurrentUser.Me(ctx, iam.MeRequest{}) if err != nil { return nil, fmt.Errorf("current user: %w", err) } diff --git a/libs/sync/path.go b/libs/sync/path.go index 3f86e8d3446..6976fd8e0d6 100644 --- a/libs/sync/path.go +++ b/libs/sync/path.go @@ -30,7 +30,7 @@ func EnsureRemotePathIsUsable(ctx context.Context, wsc *databricks.WorkspaceClie // TODO: we should cache CurrentUser.Me at the SDK level // for now we let clients pass in any existing user they might already have if me == nil { - me, err = wsc.CurrentUser.Me(ctx) + me, err = wsc.CurrentUser.Me(ctx, iam.MeRequest{}) if err != nil { return err } diff --git a/libs/template/helpers.go b/libs/template/helpers.go index eefb79537ef..33e36c02483 100644 --- a/libs/template/helpers.go +++ b/libs/template/helpers.go @@ -120,7 +120,7 @@ func loadHelpers(ctx context.Context) template.FuncMap { "user_name": func() (string, error) { if cachedUser == nil { var err error - cachedUser, err = w.CurrentUser.Me(ctx) + cachedUser, err = w.CurrentUser.Me(ctx, iam.MeRequest{}) if err != nil { return "", err } @@ -134,7 +134,7 @@ func loadHelpers(ctx context.Context) template.FuncMap { "short_name": func() (string, error) { if cachedUser == nil { var err error - cachedUser, err = w.CurrentUser.Me(ctx) + cachedUser, err = w.CurrentUser.Me(ctx, iam.MeRequest{}) if err != nil { return "", err } @@ -166,7 +166,7 @@ func loadHelpers(ctx context.Context) template.FuncMap { } if cachedUser == nil { var err error - cachedUser, err = w.CurrentUser.Me(ctx) + cachedUser, err = w.CurrentUser.Me(ctx, iam.MeRequest{}) if err != nil { return false, err } diff --git a/python/databricks/bundles/catalogs/_models/privilege.py b/python/databricks/bundles/catalogs/_models/privilege.py index 6a0215a210c..74f25b462c1 100644 --- a/python/databricks/bundles/catalogs/_models/privilege.py +++ b/python/databricks/bundles/catalogs/_models/privilege.py @@ -65,6 +65,8 @@ class Privilege(Enum): MANAGE_ACCESS = "MANAGE_ACCESS" MANAGE_ACCESS_CONTROL = "MANAGE_ACCESS_CONTROL" CREATE_SERVICE = "CREATE_SERVICE" + CREATE_FEATURE = "CREATE_FEATURE" + READ_FEATURE = "READ_FEATURE" PrivilegeParam = ( @@ -131,6 +133,8 @@ class Privilege(Enum): "MANAGE_ACCESS", "MANAGE_ACCESS_CONTROL", "CREATE_SERVICE", + "CREATE_FEATURE", + "READ_FEATURE", ] | Privilege ) diff --git a/python/databricks/bundles/jobs/__init__.py b/python/databricks/bundles/jobs/__init__.py index 308c4ba7faf..5ed6b101421 100644 --- a/python/databricks/bundles/jobs/__init__.py +++ b/python/databricks/bundles/jobs/__init__.py @@ -196,6 +196,12 @@ "PowerBiTask", "PowerBiTaskDict", "PowerBiTaskParam", + "PythonOperatorTask", + "PythonOperatorTaskDict", + "PythonOperatorTaskParam", + "PythonOperatorTaskParameter", + "PythonOperatorTaskParameterDict", + "PythonOperatorTaskParameterParam", "PythonPyPiLibrary", "PythonPyPiLibraryDict", "PythonPyPiLibraryParam", @@ -609,6 +615,16 @@ PowerBiTaskDict, PowerBiTaskParam, ) +from databricks.bundles.jobs._models.python_operator_task import ( + PythonOperatorTask, + PythonOperatorTaskDict, + PythonOperatorTaskParam, +) +from databricks.bundles.jobs._models.python_operator_task_parameter import ( + PythonOperatorTaskParameter, + PythonOperatorTaskParameterDict, + PythonOperatorTaskParameterParam, +) from databricks.bundles.jobs._models.python_py_pi_library import ( PythonPyPiLibrary, PythonPyPiLibraryDict, diff --git a/python/databricks/bundles/jobs/_models/data_security_mode.py b/python/databricks/bundles/jobs/_models/data_security_mode.py index e195d0cfc8d..2a050bfddc5 100644 --- a/python/databricks/bundles/jobs/_models/data_security_mode.py +++ b/python/databricks/bundles/jobs/_models/data_security_mode.py @@ -7,15 +7,14 @@ class DataSecurityMode(Enum): Data security mode decides what data governance model to use when accessing data from a cluster. - The following modes can only be used when `kind = CLASSIC_PREVIEW`. * `DATA_SECURITY_MODE_AUTO`: Databricks will choose the most appropriate access mode depending on your compute configuration. - * `DATA_SECURITY_MODE_STANDARD`: Alias for `USER_ISOLATION`. - * `DATA_SECURITY_MODE_DEDICATED`: Alias for `SINGLE_USER`. + * `DATA_SECURITY_MODE_STANDARD`: A secure cluster that can be shared by multiple users. Cluster users are fully isolated so that they cannot see each other’s data and credentials. Most data governance features are supported in this mode. But programming languages and cluster features might be limited. + * `DATA_SECURITY_MODE_DEDICATED`: A secure cluster that can only be exclusively used by a single user specified in `single_user_name`. Most programming languages, cluster features and data governance features are available in this mode. - The following modes can be used regardless of `kind`. - * `NONE`: No security isolation for multiple users sharing the cluster. Data governance features are not available in this mode. - * `SINGLE_USER`: A secure cluster that can only be exclusively used by a single user specified in `single_user_name`. Most programming languages, cluster features and data governance features are available in this mode. - * `USER_ISOLATION`: A secure cluster that can be shared by multiple users. Cluster users are fully isolated so that they cannot see each other's data and credentials. Most data governance features are supported in this mode. But programming languages and cluster features might be limited. + The following modes are legacy aliases for the above modes: + + * `USER_ISOLATION`: Legacy alias for `DATA_SECURITY_MODE_STANDARD`. + * `SINGLE_USER`: Legacy alias for `DATA_SECURITY_MODE_DEDICATED`. The following modes are deprecated starting with Databricks Runtime 15.0 and will be removed for future Databricks Runtime versions: diff --git a/python/databricks/bundles/jobs/_models/environment.py b/python/databricks/bundles/jobs/_models/environment.py index 3309d6f6d2d..4324405f024 100644 --- a/python/databricks/bundles/jobs/_models/environment.py +++ b/python/databricks/bundles/jobs/_models/environment.py @@ -23,7 +23,10 @@ class Environment: (e.g., `/Workspace/path/to/env.yaml`). Support for a Databricks-provided base environment ID (e.g., `workspace-base-environments/databricks_ai_v4`) and workspace base environment ID (e.g., `workspace-base-environments/dbe_b849b66e-b31a-4cb5-b161-1f2b10877fb7`) is in Beta. - Either `environment_version` or `base_environment` can be provided. For more information, see + Either `environment_version` or `base_environment` can be provided. + For more information about Databricks-provided base environments, see the + [list workspace base environments](:method:Environments/ListWorkspaceBaseEnvironments) API. + For more information, see """ client: VariableOrOptional[str] = None @@ -63,7 +66,10 @@ class EnvironmentDict(TypedDict, total=False): (e.g., `/Workspace/path/to/env.yaml`). Support for a Databricks-provided base environment ID (e.g., `workspace-base-environments/databricks_ai_v4`) and workspace base environment ID (e.g., `workspace-base-environments/dbe_b849b66e-b31a-4cb5-b161-1f2b10877fb7`) is in Beta. - Either `environment_version` or `base_environment` can be provided. For more information, see + Either `environment_version` or `base_environment` can be provided. + For more information about Databricks-provided base environments, see the + [list workspace base environments](:method:Environments/ListWorkspaceBaseEnvironments) API. + For more information, see """ client: VariableOrOptional[str] diff --git a/python/databricks/bundles/jobs/_models/pipeline_params.py b/python/databricks/bundles/jobs/_models/pipeline_params.py index 69dd3b77797..488018cb3d8 100644 --- a/python/databricks/bundles/jobs/_models/pipeline_params.py +++ b/python/databricks/bundles/jobs/_models/pipeline_params.py @@ -1,9 +1,9 @@ -from dataclasses import dataclass +from dataclasses import dataclass, field from typing import TYPE_CHECKING, TypedDict from databricks.bundles.core._transform import _transform from databricks.bundles.core._transform_to_json import _transform_to_json_value -from databricks.bundles.core._variable import VariableOrOptional +from databricks.bundles.core._variable import VariableOrList, VariableOrOptional if TYPE_CHECKING: from typing_extensions import Self @@ -18,6 +18,27 @@ class PipelineParams: If true, triggers a full refresh on the spark declarative pipeline. """ + full_refresh_selection: VariableOrList[str] = field(default_factory=list) + """ + A list of tables to update with fullRefresh. + """ + + refresh_flow_selection: VariableOrList[str] = field(default_factory=list) + """ + Flow names to selectively refresh. These are unioned with other selective refresh + options (refresh_selection, full_refresh_selection) to determine the final set of flows to refresh. + """ + + refresh_selection: VariableOrList[str] = field(default_factory=list) + """ + A list of tables to update without fullRefresh. + """ + + reset_checkpoint_selection: VariableOrList[str] = field(default_factory=list) + """ + A list of streaming flows to reset checkpoints without clearing data. + """ + @classmethod def from_dict(cls, value: "PipelineParamsDict") -> "Self": return _transform(cls, value) @@ -34,5 +55,26 @@ class PipelineParamsDict(TypedDict, total=False): If true, triggers a full refresh on the spark declarative pipeline. """ + full_refresh_selection: VariableOrList[str] + """ + A list of tables to update with fullRefresh. + """ + + refresh_flow_selection: VariableOrList[str] + """ + Flow names to selectively refresh. These are unioned with other selective refresh + options (refresh_selection, full_refresh_selection) to determine the final set of flows to refresh. + """ + + refresh_selection: VariableOrList[str] + """ + A list of tables to update without fullRefresh. + """ + + reset_checkpoint_selection: VariableOrList[str] + """ + A list of streaming flows to reset checkpoints without clearing data. + """ + PipelineParamsParam = PipelineParamsDict | PipelineParams diff --git a/python/databricks/bundles/jobs/_models/pipeline_task.py b/python/databricks/bundles/jobs/_models/pipeline_task.py index a5c22bdd986..9bca9b3e53b 100644 --- a/python/databricks/bundles/jobs/_models/pipeline_task.py +++ b/python/databricks/bundles/jobs/_models/pipeline_task.py @@ -1,9 +1,13 @@ -from dataclasses import dataclass +from dataclasses import dataclass, field from typing import TYPE_CHECKING, TypedDict from databricks.bundles.core._transform import _transform from databricks.bundles.core._transform_to_json import _transform_to_json_value -from databricks.bundles.core._variable import VariableOr, VariableOrOptional +from databricks.bundles.core._variable import ( + VariableOr, + VariableOrList, + VariableOrOptional, +) if TYPE_CHECKING: from typing_extensions import Self @@ -23,6 +27,27 @@ class PipelineTask: If true, triggers a full refresh on the spark declarative pipeline. """ + full_refresh_selection: VariableOrList[str] = field(default_factory=list) + """ + A list of tables to update with fullRefresh. + """ + + refresh_flow_selection: VariableOrList[str] = field(default_factory=list) + """ + Flow names to selectively refresh. These are unioned with other selective refresh + options (refresh_selection, full_refresh_selection) to determine the final set of flows to refresh. + """ + + refresh_selection: VariableOrList[str] = field(default_factory=list) + """ + A list of tables to update without fullRefresh. + """ + + reset_checkpoint_selection: VariableOrList[str] = field(default_factory=list) + """ + A list of streaming flows to reset checkpoints without clearing data. + """ + @classmethod def from_dict(cls, value: "PipelineTaskDict") -> "Self": return _transform(cls, value) @@ -44,5 +69,26 @@ class PipelineTaskDict(TypedDict, total=False): If true, triggers a full refresh on the spark declarative pipeline. """ + full_refresh_selection: VariableOrList[str] + """ + A list of tables to update with fullRefresh. + """ + + refresh_flow_selection: VariableOrList[str] + """ + Flow names to selectively refresh. These are unioned with other selective refresh + options (refresh_selection, full_refresh_selection) to determine the final set of flows to refresh. + """ + + refresh_selection: VariableOrList[str] + """ + A list of tables to update without fullRefresh. + """ + + reset_checkpoint_selection: VariableOrList[str] + """ + A list of streaming flows to reset checkpoints without clearing data. + """ + PipelineTaskParam = PipelineTaskDict | PipelineTask diff --git a/python/databricks/bundles/jobs/_models/python_operator_task.py b/python/databricks/bundles/jobs/_models/python_operator_task.py new file mode 100644 index 00000000000..fbce9e38cde --- /dev/null +++ b/python/databricks/bundles/jobs/_models/python_operator_task.py @@ -0,0 +1,60 @@ +from dataclasses import dataclass, field +from typing import TYPE_CHECKING, TypedDict + +from databricks.bundles.core._transform import _transform +from databricks.bundles.core._transform_to_json import _transform_to_json_value +from databricks.bundles.core._variable import VariableOrList, VariableOrOptional +from databricks.bundles.jobs._models.python_operator_task_parameter import ( + PythonOperatorTaskParameter, + PythonOperatorTaskParameterParam, +) + +if TYPE_CHECKING: + from typing_extensions import Self + + +@dataclass(kw_only=True) +class PythonOperatorTask: + """ + :meta private: [EXPERIMENTAL] + """ + + main: VariableOrOptional[str] = None + """ + Fully qualified name of the main class or function. + For example, `my_project.my_function` or `my_project.MyOperator`. + """ + + parameters: VariableOrList[PythonOperatorTaskParameter] = field( + default_factory=list + ) + """ + An ordered list of task parameters. + TODO(JOBS-30885): Add limits for parameters. + """ + + @classmethod + def from_dict(cls, value: "PythonOperatorTaskDict") -> "Self": + return _transform(cls, value) + + def as_dict(self) -> "PythonOperatorTaskDict": + return _transform_to_json_value(self) # type:ignore + + +class PythonOperatorTaskDict(TypedDict, total=False): + """""" + + main: VariableOrOptional[str] + """ + Fully qualified name of the main class or function. + For example, `my_project.my_function` or `my_project.MyOperator`. + """ + + parameters: VariableOrList[PythonOperatorTaskParameterParam] + """ + An ordered list of task parameters. + TODO(JOBS-30885): Add limits for parameters. + """ + + +PythonOperatorTaskParam = PythonOperatorTaskDict | PythonOperatorTask diff --git a/python/databricks/bundles/jobs/_models/python_operator_task_parameter.py b/python/databricks/bundles/jobs/_models/python_operator_task_parameter.py new file mode 100644 index 00000000000..5fd3628748d --- /dev/null +++ b/python/databricks/bundles/jobs/_models/python_operator_task_parameter.py @@ -0,0 +1,40 @@ +from dataclasses import dataclass +from typing import TYPE_CHECKING, TypedDict + +from databricks.bundles.core._transform import _transform +from databricks.bundles.core._transform_to_json import _transform_to_json_value +from databricks.bundles.core._variable import VariableOrOptional + +if TYPE_CHECKING: + from typing_extensions import Self + + +@dataclass(kw_only=True) +class PythonOperatorTaskParameter: + """ + :meta private: [EXPERIMENTAL] + """ + + name: VariableOrOptional[str] = None + + value: VariableOrOptional[str] = None + + @classmethod + def from_dict(cls, value: "PythonOperatorTaskParameterDict") -> "Self": + return _transform(cls, value) + + def as_dict(self) -> "PythonOperatorTaskParameterDict": + return _transform_to_json_value(self) # type:ignore + + +class PythonOperatorTaskParameterDict(TypedDict, total=False): + """""" + + name: VariableOrOptional[str] + + value: VariableOrOptional[str] + + +PythonOperatorTaskParameterParam = ( + PythonOperatorTaskParameterDict | PythonOperatorTaskParameter +) diff --git a/python/databricks/bundles/jobs/_models/task.py b/python/databricks/bundles/jobs/_models/task.py index cfac99bc571..8cb2fe0c273 100644 --- a/python/databricks/bundles/jobs/_models/task.py +++ b/python/databricks/bundles/jobs/_models/task.py @@ -50,6 +50,10 @@ PipelineTaskParam, ) from databricks.bundles.jobs._models.power_bi_task import PowerBiTask, PowerBiTaskParam +from databricks.bundles.jobs._models.python_operator_task import ( + PythonOperatorTask, + PythonOperatorTaskParam, +) from databricks.bundles.jobs._models.python_wheel_task import ( PythonWheelTask, PythonWheelTaskParam, @@ -160,8 +164,6 @@ class Task: disabled: VariableOrOptional[bool] = None """ - :meta private: [EXPERIMENTAL] - An optional flag to disable the task. If set to true, the task will not run even if it is part of a job. """ @@ -241,6 +243,13 @@ class Task: The task triggers a Power BI semantic model update when the `power_bi_task` field is present. """ + python_operator_task: VariableOrOptional[PythonOperatorTask] = None + """ + :meta private: [EXPERIMENTAL] + + The task runs a Python operator task. + """ + python_wheel_task: VariableOrOptional[PythonWheelTask] = None """ The task runs a Python wheel when the `python_wheel_task` field is present. @@ -373,8 +382,6 @@ class TaskDict(TypedDict, total=False): disabled: VariableOrOptional[bool] """ - :meta private: [EXPERIMENTAL] - An optional flag to disable the task. If set to true, the task will not run even if it is part of a job. """ @@ -454,6 +461,13 @@ class TaskDict(TypedDict, total=False): The task triggers a Power BI semantic model update when the `power_bi_task` field is present. """ + python_operator_task: VariableOrOptional[PythonOperatorTaskParam] + """ + :meta private: [EXPERIMENTAL] + + The task runs a Python operator task. + """ + python_wheel_task: VariableOrOptional[PythonWheelTaskParam] """ The task runs a Python wheel when the `python_wheel_task` field is present. diff --git a/python/databricks/bundles/pipelines/__init__.py b/python/databricks/bundles/pipelines/__init__.py index 2ef4c1e6c72..c7dbd9b41e8 100644 --- a/python/databricks/bundles/pipelines/__init__.py +++ b/python/databricks/bundles/pipelines/__init__.py @@ -103,6 +103,12 @@ "JiraConnectorOptions", "JiraConnectorOptionsDict", "JiraConnectorOptionsParam", + "JsonTransformerOptions", + "JsonTransformerOptionsDict", + "JsonTransformerOptionsParam", + "KafkaOptions", + "KafkaOptionsDict", + "KafkaOptionsParam", "Lifecycle", "LifecycleDict", "LifecycleParam", @@ -209,6 +215,11 @@ "TikTokAdsOptionsTikTokDataLevelParam", "TikTokAdsOptionsTikTokReportType", "TikTokAdsOptionsTikTokReportTypeParam", + "Transformer", + "TransformerDict", + "TransformerFormat", + "TransformerFormatParam", + "TransformerParam", "VolumesStorageInfo", "VolumesStorageInfoDict", "VolumesStorageInfoParam", @@ -398,6 +409,16 @@ JiraConnectorOptionsDict, JiraConnectorOptionsParam, ) +from databricks.bundles.pipelines._models.json_transformer_options import ( + JsonTransformerOptions, + JsonTransformerOptionsDict, + JsonTransformerOptionsParam, +) +from databricks.bundles.pipelines._models.kafka_options import ( + KafkaOptions, + KafkaOptionsDict, + KafkaOptionsParam, +) from databricks.bundles.pipelines._models.lifecycle import ( Lifecycle, LifecycleDict, @@ -576,6 +597,15 @@ TikTokAdsOptionsTikTokReportType, TikTokAdsOptionsTikTokReportTypeParam, ) +from databricks.bundles.pipelines._models.transformer import ( + Transformer, + TransformerDict, + TransformerParam, +) +from databricks.bundles.pipelines._models.transformer_format import ( + TransformerFormat, + TransformerFormatParam, +) from databricks.bundles.pipelines._models.volumes_storage_info import ( VolumesStorageInfo, VolumesStorageInfoDict, diff --git a/python/databricks/bundles/pipelines/_models/connector_options.py b/python/databricks/bundles/pipelines/_models/connector_options.py index 3f8b7add1ff..b236e16f762 100644 --- a/python/databricks/bundles/pipelines/_models/connector_options.py +++ b/python/databricks/bundles/pipelines/_models/connector_options.py @@ -20,6 +20,10 @@ JiraConnectorOptions, JiraConnectorOptionsParam, ) +from databricks.bundles.pipelines._models.kafka_options import ( + KafkaOptions, + KafkaOptionsParam, +) from databricks.bundles.pipelines._models.meta_marketing_options import ( MetaMarketingOptions, MetaMarketingOptionsParam, @@ -79,6 +83,11 @@ class ConnectorOptions: Jira specific options for ingestion """ + kafka_options: VariableOrOptional[KafkaOptions] = None + """ + :meta private: [EXPERIMENTAL] + """ + meta_ads_options: VariableOrOptional[MetaMarketingOptions] = None """ Meta Marketing (Meta Ads) specific options for ingestion @@ -152,6 +161,11 @@ class ConnectorOptionsDict(TypedDict, total=False): Jira specific options for ingestion """ + kafka_options: VariableOrOptional[KafkaOptionsParam] + """ + :meta private: [EXPERIMENTAL] + """ + meta_ads_options: VariableOrOptional[MetaMarketingOptionsParam] """ Meta Marketing (Meta Ads) specific options for ingestion diff --git a/python/databricks/bundles/pipelines/_models/file_ingestion_options_file_format.py b/python/databricks/bundles/pipelines/_models/file_ingestion_options_file_format.py index bf5838c8701..b9295c3378f 100644 --- a/python/databricks/bundles/pipelines/_models/file_ingestion_options_file_format.py +++ b/python/databricks/bundles/pipelines/_models/file_ingestion_options_file_format.py @@ -15,9 +15,12 @@ class FileIngestionOptionsFileFormat(Enum): PARQUET = "PARQUET" AVRO = "AVRO" ORC = "ORC" + FILE = "FILE" FileIngestionOptionsFileFormatParam = ( - Literal["BINARYFILE", "JSON", "CSV", "XML", "EXCEL", "PARQUET", "AVRO", "ORC"] + Literal[ + "BINARYFILE", "JSON", "CSV", "XML", "EXCEL", "PARQUET", "AVRO", "ORC", "FILE" + ] | FileIngestionOptionsFileFormat ) diff --git a/python/databricks/bundles/pipelines/_models/google_drive_options_google_drive_entity_type.py b/python/databricks/bundles/pipelines/_models/google_drive_options_google_drive_entity_type.py index 136b3aff953..4ddab6c6792 100644 --- a/python/databricks/bundles/pipelines/_models/google_drive_options_google_drive_entity_type.py +++ b/python/databricks/bundles/pipelines/_models/google_drive_options_google_drive_entity_type.py @@ -10,9 +10,13 @@ class GoogleDriveOptionsGoogleDriveEntityType(Enum): FILE = "FILE" FILE_METADATA = "FILE_METADATA" PERMISSION = "PERMISSION" + FILE_PERMISSION = "FILE_PERMISSION" + GROUP_MEMBERSHIP = "GROUP_MEMBERSHIP" GoogleDriveOptionsGoogleDriveEntityTypeParam = ( - Literal["FILE", "FILE_METADATA", "PERMISSION"] + Literal[ + "FILE", "FILE_METADATA", "PERMISSION", "FILE_PERMISSION", "GROUP_MEMBERSHIP" + ] | GoogleDriveOptionsGoogleDriveEntityType ) diff --git a/python/databricks/bundles/pipelines/_models/json_transformer_options.py b/python/databricks/bundles/pipelines/_models/json_transformer_options.py new file mode 100644 index 00000000000..26b310204b9 --- /dev/null +++ b/python/databricks/bundles/pipelines/_models/json_transformer_options.py @@ -0,0 +1,88 @@ +from dataclasses import dataclass +from typing import TYPE_CHECKING, TypedDict + +from databricks.bundles.core._transform import _transform +from databricks.bundles.core._transform_to_json import _transform_to_json_value +from databricks.bundles.core._variable import VariableOrOptional +from databricks.bundles.pipelines._models.file_ingestion_options_schema_evolution_mode import ( + FileIngestionOptionsSchemaEvolutionMode, + FileIngestionOptionsSchemaEvolutionModeParam, +) + +if TYPE_CHECKING: + from typing_extensions import Self + + +@dataclass(kw_only=True) +class JsonTransformerOptions: + """ + :meta private: [EXPERIMENTAL] + """ + + as_variant: VariableOrOptional[bool] = None + """ + Parse the entire value as a single Variant column. + """ + + schema: VariableOrOptional[str] = None + """ + Inline schema string for JSON parsing (Spark DDL format). + """ + + schema_evolution_mode: VariableOrOptional[ + FileIngestionOptionsSchemaEvolutionMode + ] = None + """ + (Optional) Schema evolution mode for schema inference. + """ + + schema_file_path: VariableOrOptional[str] = None + """ + Path to a schema file (.ddl). + """ + + schema_hints: VariableOrOptional[str] = None + """ + (Optional) Schema hints as a comma-separated string of "column_name type" pairs. + """ + + @classmethod + def from_dict(cls, value: "JsonTransformerOptionsDict") -> "Self": + return _transform(cls, value) + + def as_dict(self) -> "JsonTransformerOptionsDict": + return _transform_to_json_value(self) # type:ignore + + +class JsonTransformerOptionsDict(TypedDict, total=False): + """""" + + as_variant: VariableOrOptional[bool] + """ + Parse the entire value as a single Variant column. + """ + + schema: VariableOrOptional[str] + """ + Inline schema string for JSON parsing (Spark DDL format). + """ + + schema_evolution_mode: VariableOrOptional[ + FileIngestionOptionsSchemaEvolutionModeParam + ] + """ + (Optional) Schema evolution mode for schema inference. + """ + + schema_file_path: VariableOrOptional[str] + """ + Path to a schema file (.ddl). + """ + + schema_hints: VariableOrOptional[str] + """ + (Optional) Schema hints as a comma-separated string of "column_name type" pairs. + """ + + +JsonTransformerOptionsParam = JsonTransformerOptionsDict | JsonTransformerOptions diff --git a/python/databricks/bundles/pipelines/_models/kafka_options.py b/python/databricks/bundles/pipelines/_models/kafka_options.py new file mode 100644 index 00000000000..0b83708ee3a --- /dev/null +++ b/python/databricks/bundles/pipelines/_models/kafka_options.py @@ -0,0 +1,130 @@ +from dataclasses import dataclass, field +from typing import TYPE_CHECKING, TypedDict + +from databricks.bundles.core._transform import _transform +from databricks.bundles.core._transform_to_json import _transform_to_json_value +from databricks.bundles.core._variable import ( + VariableOrDict, + VariableOrList, + VariableOrOptional, +) +from databricks.bundles.pipelines._models.transformer import ( + Transformer, + TransformerParam, +) + +if TYPE_CHECKING: + from typing_extensions import Self + + +@dataclass(kw_only=True) +class KafkaOptions: + """ + :meta private: [EXPERIMENTAL] + """ + + client_config: VariableOrDict[str] = field(default_factory=dict) + """ + :meta private: [EXPERIMENTAL] + + Undocumented backdoor mechanism for overriding parameters + to pass to the Kafka client. + This is not supported and may break at any time. + """ + + key_transformer: VariableOrOptional[Transformer] = None + """ + (Optional) Transformer for the message key. + If not specified, the key is left as raw bytes. + """ + + max_offsets_per_trigger: VariableOrOptional[int] = None + """ + :meta private: [EXPERIMENTAL] + + Internal option to control the maximum number of offsets to process per trigger. + """ + + starting_offset: VariableOrOptional[str] = None + """ + (Optional) Where to begin reading when no checkpoint exists. + Valid values: "latest" and "earliest". Defaults to "latest". + """ + + topic_pattern: VariableOrOptional[str] = None + """ + Java regex pattern to subscribe to matching topics. + Only one of topics or topic_pattern must be specified. + """ + + topics: VariableOrList[str] = field(default_factory=list) + """ + Topics to subscribe to. + Only one of topics or topic_pattern must be specified. + """ + + value_transformer: VariableOrOptional[Transformer] = None + """ + (Optional) Transformer for the message value. + If not specified, the value is left as raw bytes. + """ + + @classmethod + def from_dict(cls, value: "KafkaOptionsDict") -> "Self": + return _transform(cls, value) + + def as_dict(self) -> "KafkaOptionsDict": + return _transform_to_json_value(self) # type:ignore + + +class KafkaOptionsDict(TypedDict, total=False): + """""" + + client_config: VariableOrDict[str] + """ + :meta private: [EXPERIMENTAL] + + Undocumented backdoor mechanism for overriding parameters + to pass to the Kafka client. + This is not supported and may break at any time. + """ + + key_transformer: VariableOrOptional[TransformerParam] + """ + (Optional) Transformer for the message key. + If not specified, the key is left as raw bytes. + """ + + max_offsets_per_trigger: VariableOrOptional[int] + """ + :meta private: [EXPERIMENTAL] + + Internal option to control the maximum number of offsets to process per trigger. + """ + + starting_offset: VariableOrOptional[str] + """ + (Optional) Where to begin reading when no checkpoint exists. + Valid values: "latest" and "earliest". Defaults to "latest". + """ + + topic_pattern: VariableOrOptional[str] + """ + Java regex pattern to subscribe to matching topics. + Only one of topics or topic_pattern must be specified. + """ + + topics: VariableOrList[str] + """ + Topics to subscribe to. + Only one of topics or topic_pattern must be specified. + """ + + value_transformer: VariableOrOptional[TransformerParam] + """ + (Optional) Transformer for the message value. + If not specified, the value is left as raw bytes. + """ + + +KafkaOptionsParam = KafkaOptionsDict | KafkaOptions diff --git a/python/databricks/bundles/pipelines/_models/pipeline.py b/python/databricks/bundles/pipelines/_models/pipeline.py index 284a3734897..0756c44af51 100644 --- a/python/databricks/bundles/pipelines/_models/pipeline.py +++ b/python/databricks/bundles/pipelines/_models/pipeline.py @@ -25,10 +25,7 @@ IngestionPipelineDefinition, IngestionPipelineDefinitionParam, ) -from databricks.bundles.pipelines._models.lifecycle import ( - Lifecycle, - LifecycleParam, -) +from databricks.bundles.pipelines._models.lifecycle import Lifecycle, LifecycleParam from databricks.bundles.pipelines._models.notifications import ( Notifications, NotificationsParam, diff --git a/python/databricks/bundles/pipelines/_models/sharepoint_options_sharepoint_entity_type.py b/python/databricks/bundles/pipelines/_models/sharepoint_options_sharepoint_entity_type.py index 46e15fff79d..21f76eca27f 100644 --- a/python/databricks/bundles/pipelines/_models/sharepoint_options_sharepoint_entity_type.py +++ b/python/databricks/bundles/pipelines/_models/sharepoint_options_sharepoint_entity_type.py @@ -11,9 +11,18 @@ class SharepointOptionsSharepointEntityType(Enum): FILE_METADATA = "FILE_METADATA" PERMISSION = "PERMISSION" LIST = "LIST" + FILE_PERMISSION = "FILE_PERMISSION" + GROUP_MEMBERSHIP = "GROUP_MEMBERSHIP" SharepointOptionsSharepointEntityTypeParam = ( - Literal["FILE", "FILE_METADATA", "PERMISSION", "LIST"] + Literal[ + "FILE", + "FILE_METADATA", + "PERMISSION", + "LIST", + "FILE_PERMISSION", + "GROUP_MEMBERSHIP", + ] | SharepointOptionsSharepointEntityType ) diff --git a/python/databricks/bundles/pipelines/_models/transformer.py b/python/databricks/bundles/pipelines/_models/transformer.py new file mode 100644 index 00000000000..b707307fbbc --- /dev/null +++ b/python/databricks/bundles/pipelines/_models/transformer.py @@ -0,0 +1,54 @@ +from dataclasses import dataclass +from typing import TYPE_CHECKING, TypedDict + +from databricks.bundles.core._transform import _transform +from databricks.bundles.core._transform_to_json import _transform_to_json_value +from databricks.bundles.core._variable import VariableOrOptional +from databricks.bundles.pipelines._models.json_transformer_options import ( + JsonTransformerOptions, + JsonTransformerOptionsParam, +) +from databricks.bundles.pipelines._models.transformer_format import ( + TransformerFormat, + TransformerFormatParam, +) + +if TYPE_CHECKING: + from typing_extensions import Self + + +@dataclass(kw_only=True) +class Transformer: + """ + :meta private: [EXPERIMENTAL] + + Specifies how to transform binary data into structured data. + """ + + format: VariableOrOptional[TransformerFormat] = None + """ + Required: the wire format of the data. + """ + + json_options: VariableOrOptional[JsonTransformerOptions] = None + + @classmethod + def from_dict(cls, value: "TransformerDict") -> "Self": + return _transform(cls, value) + + def as_dict(self) -> "TransformerDict": + return _transform_to_json_value(self) # type:ignore + + +class TransformerDict(TypedDict, total=False): + """""" + + format: VariableOrOptional[TransformerFormatParam] + """ + Required: the wire format of the data. + """ + + json_options: VariableOrOptional[JsonTransformerOptionsParam] + + +TransformerParam = TransformerDict | Transformer diff --git a/python/databricks/bundles/pipelines/_models/transformer_format.py b/python/databricks/bundles/pipelines/_models/transformer_format.py new file mode 100644 index 00000000000..b37db5110ce --- /dev/null +++ b/python/databricks/bundles/pipelines/_models/transformer_format.py @@ -0,0 +1,18 @@ +from enum import Enum +from typing import Literal + + +class TransformerFormat(Enum): + """ + :meta private: [EXPERIMENTAL] + """ + + STRING = "STRING" + JSON = "JSON" + AVRO = "AVRO" + PROTOBUF = "PROTOBUF" + + +TransformerFormatParam = ( + Literal["STRING", "JSON", "AVRO", "PROTOBUF"] | TransformerFormat +) diff --git a/python/databricks/bundles/schemas/_models/privilege.py b/python/databricks/bundles/schemas/_models/privilege.py index 6a0215a210c..74f25b462c1 100644 --- a/python/databricks/bundles/schemas/_models/privilege.py +++ b/python/databricks/bundles/schemas/_models/privilege.py @@ -65,6 +65,8 @@ class Privilege(Enum): MANAGE_ACCESS = "MANAGE_ACCESS" MANAGE_ACCESS_CONTROL = "MANAGE_ACCESS_CONTROL" CREATE_SERVICE = "CREATE_SERVICE" + CREATE_FEATURE = "CREATE_FEATURE" + READ_FEATURE = "READ_FEATURE" PrivilegeParam = ( @@ -131,6 +133,8 @@ class Privilege(Enum): "MANAGE_ACCESS", "MANAGE_ACCESS_CONTROL", "CREATE_SERVICE", + "CREATE_FEATURE", + "READ_FEATURE", ] | Privilege ) diff --git a/python/databricks/bundles/volumes/_models/privilege.py b/python/databricks/bundles/volumes/_models/privilege.py index 6a0215a210c..74f25b462c1 100644 --- a/python/databricks/bundles/volumes/_models/privilege.py +++ b/python/databricks/bundles/volumes/_models/privilege.py @@ -65,6 +65,8 @@ class Privilege(Enum): MANAGE_ACCESS = "MANAGE_ACCESS" MANAGE_ACCESS_CONTROL = "MANAGE_ACCESS_CONTROL" CREATE_SERVICE = "CREATE_SERVICE" + CREATE_FEATURE = "CREATE_FEATURE" + READ_FEATURE = "READ_FEATURE" PrivilegeParam = ( @@ -131,6 +133,8 @@ class Privilege(Enum): "MANAGE_ACCESS", "MANAGE_ACCESS_CONTROL", "CREATE_SERVICE", + "CREATE_FEATURE", + "READ_FEATURE", ] | Privilege ) From 980331978ef0ab142e9ec911f290cb54f875be8b Mon Sep 17 00:00:00 2001 From: Shreyas Goenka Date: Thu, 21 May 2026 12:58:58 +0000 Subject: [PATCH 2/7] Skip auto-generated `bundle` workspace command; restore tagging.yml/py file modes MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 8bit The SDK v0.135 added a workspace-level `bundle` service (DMS) whose auto-generated cobra command at `cmd/workspace/bundle/bundle.go` uses `Use: "bundle"` — the same name as the existing DAB `bundle` command tree (`cmd/bundle`). Registering both as top-level subcommands of `cli` clobbered the DAB tree's help output, so e.g. `databricks bundle debug refschema --help` printed the DMS service description and the DMS subcommand list instead of the refschema help. Filter the workspace `bundle` command out of the registration loop in `cmd/cmd.go`. The DMS endpoints remain reachable via `databricks api` calls. A follow-up PR will resurface these commands under proper DAB sub-groups (`databricks bundle deployments`, `versions`, `resources`, `operations`). Also restore file modes for `.github/workflows/tagging.yml` and `internal/genkit/tagging.py` (genkit's post-processing inadvertently flipped both to 0755; main has them at 0644), and update the `acceptance/bundle/refschema/{output.txt,out.fields.txt}` goldens that were corrupted in the previous commit by the same bundle namespace collision (refschema --help now prints its own help; out.fields.txt now contains the actual field dump that the previous run never produced). Co-authored-by: Isaac --- .github/workflows/tagging.yml | 0 acceptance/bundle/refschema/out.fields.txt | 3307 ++++++++++++++++++++ acceptance/bundle/refschema/output.txt | 65 +- cmd/cmd.go | 7 + internal/genkit/tagging.py | 0 5 files changed, 3322 insertions(+), 57 deletions(-) mode change 100755 => 100644 .github/workflows/tagging.yml mode change 100755 => 100644 internal/genkit/tagging.py diff --git a/.github/workflows/tagging.yml b/.github/workflows/tagging.yml old mode 100755 new mode 100644 diff --git a/acceptance/bundle/refschema/out.fields.txt b/acceptance/bundle/refschema/out.fields.txt index e69de29bb2d..f433389916f 100644 --- a/acceptance/bundle/refschema/out.fields.txt +++ b/acceptance/bundle/refschema/out.fields.txt @@ -0,0 +1,3307 @@ +resources.alerts.*.create_time string ALL +resources.alerts.*.custom_description string ALL +resources.alerts.*.custom_summary string ALL +resources.alerts.*.display_name string ALL +resources.alerts.*.effective_run_as *sql.AlertV2RunAs ALL +resources.alerts.*.effective_run_as.service_principal_name string ALL +resources.alerts.*.effective_run_as.user_name string ALL +resources.alerts.*.evaluation sql.AlertV2Evaluation ALL +resources.alerts.*.evaluation.comparison_operator sql.ComparisonOperator ALL +resources.alerts.*.evaluation.empty_result_state sql.AlertEvaluationState ALL +resources.alerts.*.evaluation.last_evaluated_at string ALL +resources.alerts.*.evaluation.notification *sql.AlertV2Notification ALL +resources.alerts.*.evaluation.notification.notify_on_ok bool ALL +resources.alerts.*.evaluation.notification.retrigger_seconds int ALL +resources.alerts.*.evaluation.notification.subscriptions []sql.AlertV2Subscription ALL +resources.alerts.*.evaluation.notification.subscriptions[*] sql.AlertV2Subscription ALL +resources.alerts.*.evaluation.notification.subscriptions[*].destination_id string ALL +resources.alerts.*.evaluation.notification.subscriptions[*].user_email string ALL +resources.alerts.*.evaluation.source sql.AlertV2OperandColumn ALL +resources.alerts.*.evaluation.source.aggregation sql.Aggregation ALL +resources.alerts.*.evaluation.source.display string ALL +resources.alerts.*.evaluation.source.name string ALL +resources.alerts.*.evaluation.state sql.AlertEvaluationState ALL +resources.alerts.*.evaluation.threshold *sql.AlertV2Operand ALL +resources.alerts.*.evaluation.threshold.column *sql.AlertV2OperandColumn ALL +resources.alerts.*.evaluation.threshold.column.aggregation sql.Aggregation ALL +resources.alerts.*.evaluation.threshold.column.display string ALL +resources.alerts.*.evaluation.threshold.column.name string ALL +resources.alerts.*.evaluation.threshold.value *sql.AlertV2OperandValue ALL +resources.alerts.*.evaluation.threshold.value.bool_value bool ALL +resources.alerts.*.evaluation.threshold.value.double_value float64 ALL +resources.alerts.*.evaluation.threshold.value.string_value string ALL +resources.alerts.*.file_path string INPUT +resources.alerts.*.id string ALL +resources.alerts.*.lifecycle resources.Lifecycle INPUT +resources.alerts.*.lifecycle.prevent_destroy bool INPUT +resources.alerts.*.lifecycle_state sql.AlertLifecycleState ALL +resources.alerts.*.modified_status string INPUT +resources.alerts.*.owner_user_name string ALL +resources.alerts.*.parent_path string ALL +resources.alerts.*.query_text string ALL +resources.alerts.*.run_as *sql.AlertV2RunAs ALL +resources.alerts.*.run_as.service_principal_name string ALL +resources.alerts.*.run_as.user_name string ALL +resources.alerts.*.run_as_user_name string ALL +resources.alerts.*.schedule sql.CronSchedule ALL +resources.alerts.*.schedule.pause_status sql.SchedulePauseStatus ALL +resources.alerts.*.schedule.quartz_cron_schedule string ALL +resources.alerts.*.schedule.timezone_id string ALL +resources.alerts.*.update_time string ALL +resources.alerts.*.url string INPUT +resources.alerts.*.warehouse_id string ALL +resources.alerts.*.permissions.object_id string ALL +resources.alerts.*.permissions[*] dresources.StatePermission ALL +resources.alerts.*.permissions[*].group_name string ALL +resources.alerts.*.permissions[*].level iam.PermissionLevel ALL +resources.alerts.*.permissions[*].service_principal_name string ALL +resources.alerts.*.permissions[*].user_name string ALL +resources.apps.*.active_deployment *apps.AppDeployment ALL +resources.apps.*.active_deployment.command []string ALL +resources.apps.*.active_deployment.command[*] string ALL +resources.apps.*.active_deployment.create_time string ALL +resources.apps.*.active_deployment.creator string ALL +resources.apps.*.active_deployment.deployment_artifacts *apps.AppDeploymentArtifacts ALL +resources.apps.*.active_deployment.deployment_artifacts.source_code_path string ALL +resources.apps.*.active_deployment.deployment_id string ALL +resources.apps.*.active_deployment.env_vars []apps.EnvVar ALL +resources.apps.*.active_deployment.env_vars[*] apps.EnvVar ALL +resources.apps.*.active_deployment.env_vars[*].name string ALL +resources.apps.*.active_deployment.env_vars[*].value string ALL +resources.apps.*.active_deployment.env_vars[*].value_from string ALL +resources.apps.*.active_deployment.git_source *apps.GitSource ALL +resources.apps.*.active_deployment.git_source.branch string ALL +resources.apps.*.active_deployment.git_source.commit string ALL +resources.apps.*.active_deployment.git_source.git_repository *apps.GitRepository ALL +resources.apps.*.active_deployment.git_source.git_repository.provider string ALL +resources.apps.*.active_deployment.git_source.git_repository.url string ALL +resources.apps.*.active_deployment.git_source.resolved_commit string ALL +resources.apps.*.active_deployment.git_source.source_code_path string ALL +resources.apps.*.active_deployment.git_source.tag string ALL +resources.apps.*.active_deployment.mode apps.AppDeploymentMode ALL +resources.apps.*.active_deployment.source_code_path string ALL +resources.apps.*.active_deployment.status *apps.AppDeploymentStatus ALL +resources.apps.*.active_deployment.status.message string ALL +resources.apps.*.active_deployment.status.state apps.AppDeploymentState ALL +resources.apps.*.active_deployment.update_time string ALL +resources.apps.*.app_status *apps.ApplicationStatus ALL +resources.apps.*.app_status.message string ALL +resources.apps.*.app_status.state apps.ApplicationState ALL +resources.apps.*.budget_policy_id string ALL +resources.apps.*.compute_size apps.ComputeSize ALL +resources.apps.*.compute_status *apps.ComputeStatus ALL +resources.apps.*.compute_status.active_instances int ALL +resources.apps.*.compute_status.message string ALL +resources.apps.*.compute_status.state apps.ComputeState ALL +resources.apps.*.config *resources.AppConfig ALL +resources.apps.*.config.command []string ALL +resources.apps.*.config.command[*] string ALL +resources.apps.*.config.env []resources.AppEnvVar ALL +resources.apps.*.config.env[*] resources.AppEnvVar ALL +resources.apps.*.config.env[*].name string ALL +resources.apps.*.config.env[*].value string ALL +resources.apps.*.config.env[*].value_from string ALL +resources.apps.*.create_time string ALL +resources.apps.*.creator string ALL +resources.apps.*.default_source_code_path string ALL +resources.apps.*.description string ALL +resources.apps.*.effective_budget_policy_id string ALL +resources.apps.*.effective_usage_policy_id string ALL +resources.apps.*.effective_user_api_scopes []string ALL +resources.apps.*.effective_user_api_scopes[*] string ALL +resources.apps.*.git_repository *apps.GitRepository ALL +resources.apps.*.git_repository.provider string ALL +resources.apps.*.git_repository.url string ALL +resources.apps.*.git_source *apps.GitSource ALL +resources.apps.*.git_source.branch string ALL +resources.apps.*.git_source.commit string ALL +resources.apps.*.git_source.git_repository *apps.GitRepository ALL +resources.apps.*.git_source.git_repository.provider string ALL +resources.apps.*.git_source.git_repository.url string ALL +resources.apps.*.git_source.resolved_commit string ALL +resources.apps.*.git_source.source_code_path string ALL +resources.apps.*.git_source.tag string ALL +resources.apps.*.id string ALL +resources.apps.*.lifecycle *dresources.AppStateLifecycle REMOTE STATE +resources.apps.*.lifecycle *resources.LifecycleWithStarted INPUT +resources.apps.*.lifecycle resources.Lifecycle INPUT +resources.apps.*.lifecycle.prevent_destroy bool INPUT +resources.apps.*.lifecycle.started *bool ALL +resources.apps.*.modified_status string INPUT +resources.apps.*.name string ALL +resources.apps.*.oauth2_app_client_id string ALL +resources.apps.*.oauth2_app_integration_id string ALL +resources.apps.*.pending_deployment *apps.AppDeployment ALL +resources.apps.*.pending_deployment.command []string ALL +resources.apps.*.pending_deployment.command[*] string ALL +resources.apps.*.pending_deployment.create_time string ALL +resources.apps.*.pending_deployment.creator string ALL +resources.apps.*.pending_deployment.deployment_artifacts *apps.AppDeploymentArtifacts ALL +resources.apps.*.pending_deployment.deployment_artifacts.source_code_path string ALL +resources.apps.*.pending_deployment.deployment_id string ALL +resources.apps.*.pending_deployment.env_vars []apps.EnvVar ALL +resources.apps.*.pending_deployment.env_vars[*] apps.EnvVar ALL +resources.apps.*.pending_deployment.env_vars[*].name string ALL +resources.apps.*.pending_deployment.env_vars[*].value string ALL +resources.apps.*.pending_deployment.env_vars[*].value_from string ALL +resources.apps.*.pending_deployment.git_source *apps.GitSource ALL +resources.apps.*.pending_deployment.git_source.branch string ALL +resources.apps.*.pending_deployment.git_source.commit string ALL +resources.apps.*.pending_deployment.git_source.git_repository *apps.GitRepository ALL +resources.apps.*.pending_deployment.git_source.git_repository.provider string ALL +resources.apps.*.pending_deployment.git_source.git_repository.url string ALL +resources.apps.*.pending_deployment.git_source.resolved_commit string ALL +resources.apps.*.pending_deployment.git_source.source_code_path string ALL +resources.apps.*.pending_deployment.git_source.tag string ALL +resources.apps.*.pending_deployment.mode apps.AppDeploymentMode ALL +resources.apps.*.pending_deployment.source_code_path string ALL +resources.apps.*.pending_deployment.status *apps.AppDeploymentStatus ALL +resources.apps.*.pending_deployment.status.message string ALL +resources.apps.*.pending_deployment.status.state apps.AppDeploymentState ALL +resources.apps.*.pending_deployment.update_time string ALL +resources.apps.*.resources []apps.AppResource ALL +resources.apps.*.resources[*] apps.AppResource ALL +resources.apps.*.resources[*].app *apps.AppResourceApp ALL +resources.apps.*.resources[*].app.name string ALL +resources.apps.*.resources[*].app.permission apps.AppResourceAppAppPermission ALL +resources.apps.*.resources[*].database *apps.AppResourceDatabase ALL +resources.apps.*.resources[*].database.database_name string ALL +resources.apps.*.resources[*].database.instance_name string ALL +resources.apps.*.resources[*].database.permission apps.AppResourceDatabaseDatabasePermission ALL +resources.apps.*.resources[*].description string ALL +resources.apps.*.resources[*].experiment *apps.AppResourceExperiment ALL +resources.apps.*.resources[*].experiment.experiment_id string ALL +resources.apps.*.resources[*].experiment.permission apps.AppResourceExperimentExperimentPermission ALL +resources.apps.*.resources[*].genie_space *apps.AppResourceGenieSpace ALL +resources.apps.*.resources[*].genie_space.name string ALL +resources.apps.*.resources[*].genie_space.permission apps.AppResourceGenieSpaceGenieSpacePermission ALL +resources.apps.*.resources[*].genie_space.space_id string ALL +resources.apps.*.resources[*].job *apps.AppResourceJob ALL +resources.apps.*.resources[*].job.id string ALL +resources.apps.*.resources[*].job.permission apps.AppResourceJobJobPermission ALL +resources.apps.*.resources[*].name string ALL +resources.apps.*.resources[*].postgres *apps.AppResourcePostgres ALL +resources.apps.*.resources[*].postgres.branch string ALL +resources.apps.*.resources[*].postgres.database string ALL +resources.apps.*.resources[*].postgres.permission apps.AppResourcePostgresPostgresPermission ALL +resources.apps.*.resources[*].secret *apps.AppResourceSecret ALL +resources.apps.*.resources[*].secret.key string ALL +resources.apps.*.resources[*].secret.permission apps.AppResourceSecretSecretPermission ALL +resources.apps.*.resources[*].secret.scope string ALL +resources.apps.*.resources[*].serving_endpoint *apps.AppResourceServingEndpoint ALL +resources.apps.*.resources[*].serving_endpoint.name string ALL +resources.apps.*.resources[*].serving_endpoint.permission apps.AppResourceServingEndpointServingEndpointPermission ALL +resources.apps.*.resources[*].sql_warehouse *apps.AppResourceSqlWarehouse ALL +resources.apps.*.resources[*].sql_warehouse.id string ALL +resources.apps.*.resources[*].sql_warehouse.permission apps.AppResourceSqlWarehouseSqlWarehousePermission ALL +resources.apps.*.resources[*].uc_securable *apps.AppResourceUcSecurable ALL +resources.apps.*.resources[*].uc_securable.permission apps.AppResourceUcSecurableUcSecurablePermission ALL +resources.apps.*.resources[*].uc_securable.securable_full_name string ALL +resources.apps.*.resources[*].uc_securable.securable_kind string ALL +resources.apps.*.resources[*].uc_securable.securable_type apps.AppResourceUcSecurableUcSecurableType ALL +resources.apps.*.service_principal_client_id string ALL +resources.apps.*.service_principal_id int64 ALL +resources.apps.*.service_principal_name string ALL +resources.apps.*.source_code_path string ALL +resources.apps.*.space string ALL +resources.apps.*.telemetry_export_destinations []apps.TelemetryExportDestination ALL +resources.apps.*.telemetry_export_destinations[*] apps.TelemetryExportDestination ALL +resources.apps.*.telemetry_export_destinations[*].unity_catalog *apps.UnityCatalog ALL +resources.apps.*.telemetry_export_destinations[*].unity_catalog.logs_table string ALL +resources.apps.*.telemetry_export_destinations[*].unity_catalog.metrics_table string ALL +resources.apps.*.telemetry_export_destinations[*].unity_catalog.traces_table string ALL +resources.apps.*.thumbnail_url string ALL +resources.apps.*.update_time string ALL +resources.apps.*.updater string ALL +resources.apps.*.url string ALL +resources.apps.*.usage_policy_id string ALL +resources.apps.*.user_api_scopes []string ALL +resources.apps.*.user_api_scopes[*] string ALL +resources.apps.*.permissions.object_id string ALL +resources.apps.*.permissions[*] dresources.StatePermission ALL +resources.apps.*.permissions[*].group_name string ALL +resources.apps.*.permissions[*].level iam.PermissionLevel ALL +resources.apps.*.permissions[*].service_principal_name string ALL +resources.apps.*.permissions[*].user_name string ALL +resources.catalogs.*.browse_only bool REMOTE +resources.catalogs.*.catalog_type catalog.CatalogType REMOTE +resources.catalogs.*.comment string ALL +resources.catalogs.*.connection_name string ALL +resources.catalogs.*.created_at int64 REMOTE +resources.catalogs.*.created_by string REMOTE +resources.catalogs.*.effective_predictive_optimization_flag *catalog.EffectivePredictiveOptimizationFlag REMOTE +resources.catalogs.*.effective_predictive_optimization_flag.inherited_from_name string REMOTE +resources.catalogs.*.effective_predictive_optimization_flag.inherited_from_type catalog.EffectivePredictiveOptimizationFlagInheritedFromType REMOTE +resources.catalogs.*.effective_predictive_optimization_flag.value catalog.EnablePredictiveOptimization REMOTE +resources.catalogs.*.enable_predictive_optimization catalog.EnablePredictiveOptimization REMOTE +resources.catalogs.*.full_name string REMOTE +resources.catalogs.*.id string INPUT +resources.catalogs.*.isolation_mode catalog.CatalogIsolationMode REMOTE +resources.catalogs.*.lifecycle resources.Lifecycle INPUT +resources.catalogs.*.lifecycle.prevent_destroy bool INPUT +resources.catalogs.*.managed_encryption_settings *catalog.EncryptionSettings ALL +resources.catalogs.*.managed_encryption_settings.azure_encryption_settings *catalog.AzureEncryptionSettings ALL +resources.catalogs.*.managed_encryption_settings.azure_encryption_settings.azure_cmk_access_connector_id string ALL +resources.catalogs.*.managed_encryption_settings.azure_encryption_settings.azure_cmk_managed_identity_id string ALL +resources.catalogs.*.managed_encryption_settings.azure_encryption_settings.azure_tenant_id string ALL +resources.catalogs.*.managed_encryption_settings.azure_key_vault_key_id string ALL +resources.catalogs.*.managed_encryption_settings.customer_managed_key_id string ALL +resources.catalogs.*.metastore_id string REMOTE +resources.catalogs.*.modified_status string INPUT +resources.catalogs.*.name string ALL +resources.catalogs.*.options map[string]string ALL +resources.catalogs.*.options.* string ALL +resources.catalogs.*.owner string REMOTE +resources.catalogs.*.properties map[string]string ALL +resources.catalogs.*.properties.* string ALL +resources.catalogs.*.provider_name string ALL +resources.catalogs.*.provisioning_info *catalog.ProvisioningInfo REMOTE +resources.catalogs.*.provisioning_info.state catalog.ProvisioningInfoState REMOTE +resources.catalogs.*.securable_type catalog.SecurableType REMOTE +resources.catalogs.*.share_name string ALL +resources.catalogs.*.storage_location string REMOTE +resources.catalogs.*.storage_root string ALL +resources.catalogs.*.updated_at int64 REMOTE +resources.catalogs.*.updated_by string REMOTE +resources.catalogs.*.url string INPUT +resources.catalogs.*.grants.full_name string ALL +resources.catalogs.*.grants.securable_type string ALL +resources.catalogs.*.grants[*] catalog.PrivilegeAssignment ALL +resources.catalogs.*.grants[*].principal string ALL +resources.catalogs.*.grants[*].privileges []catalog.Privilege ALL +resources.catalogs.*.grants[*].privileges[*] catalog.Privilege ALL +resources.clusters.*.apply_policy_default_values bool INPUT STATE +resources.clusters.*.autoscale *compute.AutoScale ALL +resources.clusters.*.autoscale.max_workers int ALL +resources.clusters.*.autoscale.min_workers int ALL +resources.clusters.*.autotermination_minutes int ALL +resources.clusters.*.aws_attributes *compute.AwsAttributes ALL +resources.clusters.*.aws_attributes.availability compute.AwsAvailability ALL +resources.clusters.*.aws_attributes.ebs_volume_count int ALL +resources.clusters.*.aws_attributes.ebs_volume_iops int ALL +resources.clusters.*.aws_attributes.ebs_volume_size int ALL +resources.clusters.*.aws_attributes.ebs_volume_throughput int ALL +resources.clusters.*.aws_attributes.ebs_volume_type compute.EbsVolumeType ALL +resources.clusters.*.aws_attributes.first_on_demand int ALL +resources.clusters.*.aws_attributes.instance_profile_arn string ALL +resources.clusters.*.aws_attributes.spot_bid_price_percent int ALL +resources.clusters.*.aws_attributes.zone_id string ALL +resources.clusters.*.azure_attributes *compute.AzureAttributes ALL +resources.clusters.*.azure_attributes.availability compute.AzureAvailability ALL +resources.clusters.*.azure_attributes.first_on_demand int ALL +resources.clusters.*.azure_attributes.log_analytics_info *compute.LogAnalyticsInfo ALL +resources.clusters.*.azure_attributes.log_analytics_info.log_analytics_primary_key string ALL +resources.clusters.*.azure_attributes.log_analytics_info.log_analytics_workspace_id string ALL +resources.clusters.*.azure_attributes.spot_bid_max_price float64 ALL +resources.clusters.*.cluster_cores float64 REMOTE +resources.clusters.*.cluster_id string REMOTE +resources.clusters.*.cluster_log_conf *compute.ClusterLogConf ALL +resources.clusters.*.cluster_log_conf.dbfs *compute.DbfsStorageInfo ALL +resources.clusters.*.cluster_log_conf.dbfs.destination string ALL +resources.clusters.*.cluster_log_conf.s3 *compute.S3StorageInfo ALL +resources.clusters.*.cluster_log_conf.s3.canned_acl string ALL +resources.clusters.*.cluster_log_conf.s3.destination string ALL +resources.clusters.*.cluster_log_conf.s3.enable_encryption bool ALL +resources.clusters.*.cluster_log_conf.s3.encryption_type string ALL +resources.clusters.*.cluster_log_conf.s3.endpoint string ALL +resources.clusters.*.cluster_log_conf.s3.kms_key string ALL +resources.clusters.*.cluster_log_conf.s3.region string ALL +resources.clusters.*.cluster_log_conf.volumes *compute.VolumesStorageInfo ALL +resources.clusters.*.cluster_log_conf.volumes.destination string ALL +resources.clusters.*.cluster_log_status *compute.LogSyncStatus REMOTE +resources.clusters.*.cluster_log_status.last_attempted int64 REMOTE +resources.clusters.*.cluster_log_status.last_exception string REMOTE +resources.clusters.*.cluster_memory_mb int64 REMOTE +resources.clusters.*.cluster_name string ALL +resources.clusters.*.cluster_source compute.ClusterSource REMOTE +resources.clusters.*.creator_user_name string REMOTE +resources.clusters.*.custom_tags map[string]string ALL +resources.clusters.*.custom_tags.* string ALL +resources.clusters.*.data_security_mode compute.DataSecurityMode ALL +resources.clusters.*.default_tags map[string]string REMOTE +resources.clusters.*.default_tags.* string REMOTE +resources.clusters.*.docker_image *compute.DockerImage ALL +resources.clusters.*.docker_image.basic_auth *compute.DockerBasicAuth ALL +resources.clusters.*.docker_image.basic_auth.password string ALL +resources.clusters.*.docker_image.basic_auth.username string ALL +resources.clusters.*.docker_image.url string ALL +resources.clusters.*.driver *compute.SparkNode REMOTE +resources.clusters.*.driver.host_private_ip string REMOTE +resources.clusters.*.driver.instance_id string REMOTE +resources.clusters.*.driver.node_aws_attributes *compute.SparkNodeAwsAttributes REMOTE +resources.clusters.*.driver.node_aws_attributes.is_spot bool REMOTE +resources.clusters.*.driver.node_id string REMOTE +resources.clusters.*.driver.private_ip string REMOTE +resources.clusters.*.driver.public_dns string REMOTE +resources.clusters.*.driver.start_timestamp int64 REMOTE +resources.clusters.*.driver_instance_pool_id string ALL +resources.clusters.*.driver_node_type_flexibility *compute.NodeTypeFlexibility ALL +resources.clusters.*.driver_node_type_flexibility.alternate_node_type_ids []string ALL +resources.clusters.*.driver_node_type_flexibility.alternate_node_type_ids[*] string ALL +resources.clusters.*.driver_node_type_id string ALL +resources.clusters.*.enable_elastic_disk bool ALL +resources.clusters.*.enable_local_disk_encryption bool ALL +resources.clusters.*.executors []compute.SparkNode REMOTE +resources.clusters.*.executors[*] compute.SparkNode REMOTE +resources.clusters.*.executors[*].host_private_ip string REMOTE +resources.clusters.*.executors[*].instance_id string REMOTE +resources.clusters.*.executors[*].node_aws_attributes *compute.SparkNodeAwsAttributes REMOTE +resources.clusters.*.executors[*].node_aws_attributes.is_spot bool REMOTE +resources.clusters.*.executors[*].node_id string REMOTE +resources.clusters.*.executors[*].private_ip string REMOTE +resources.clusters.*.executors[*].public_dns string REMOTE +resources.clusters.*.executors[*].start_timestamp int64 REMOTE +resources.clusters.*.gcp_attributes *compute.GcpAttributes ALL +resources.clusters.*.gcp_attributes.availability compute.GcpAvailability ALL +resources.clusters.*.gcp_attributes.boot_disk_size int ALL +resources.clusters.*.gcp_attributes.confidential_compute_type compute.ConfidentialComputeType ALL +resources.clusters.*.gcp_attributes.first_on_demand int ALL +resources.clusters.*.gcp_attributes.google_service_account string ALL +resources.clusters.*.gcp_attributes.local_ssd_count int ALL +resources.clusters.*.gcp_attributes.use_preemptible_executors bool ALL +resources.clusters.*.gcp_attributes.zone_id string ALL +resources.clusters.*.id string INPUT +resources.clusters.*.init_scripts []compute.InitScriptInfo ALL +resources.clusters.*.init_scripts[*] compute.InitScriptInfo ALL +resources.clusters.*.init_scripts[*].abfss *compute.Adlsgen2Info ALL +resources.clusters.*.init_scripts[*].abfss.destination string ALL +resources.clusters.*.init_scripts[*].dbfs *compute.DbfsStorageInfo ALL +resources.clusters.*.init_scripts[*].dbfs.destination string ALL +resources.clusters.*.init_scripts[*].file *compute.LocalFileInfo ALL +resources.clusters.*.init_scripts[*].file.destination string ALL +resources.clusters.*.init_scripts[*].gcs *compute.GcsStorageInfo ALL +resources.clusters.*.init_scripts[*].gcs.destination string ALL +resources.clusters.*.init_scripts[*].s3 *compute.S3StorageInfo ALL +resources.clusters.*.init_scripts[*].s3.canned_acl string ALL +resources.clusters.*.init_scripts[*].s3.destination string ALL +resources.clusters.*.init_scripts[*].s3.enable_encryption bool ALL +resources.clusters.*.init_scripts[*].s3.encryption_type string ALL +resources.clusters.*.init_scripts[*].s3.endpoint string ALL +resources.clusters.*.init_scripts[*].s3.kms_key string ALL +resources.clusters.*.init_scripts[*].s3.region string ALL +resources.clusters.*.init_scripts[*].volumes *compute.VolumesStorageInfo ALL +resources.clusters.*.init_scripts[*].volumes.destination string ALL +resources.clusters.*.init_scripts[*].workspace *compute.WorkspaceStorageInfo ALL +resources.clusters.*.init_scripts[*].workspace.destination string ALL +resources.clusters.*.instance_pool_id string ALL +resources.clusters.*.is_single_node bool ALL +resources.clusters.*.jdbc_port int REMOTE +resources.clusters.*.kind compute.Kind ALL +resources.clusters.*.last_restarted_time int64 REMOTE +resources.clusters.*.last_state_loss_time int64 REMOTE +resources.clusters.*.lifecycle resources.Lifecycle INPUT +resources.clusters.*.lifecycle.prevent_destroy bool INPUT +resources.clusters.*.modified_status string INPUT +resources.clusters.*.node_type_id string ALL +resources.clusters.*.num_workers int ALL +resources.clusters.*.policy_id string ALL +resources.clusters.*.remote_disk_throughput int ALL +resources.clusters.*.runtime_engine compute.RuntimeEngine ALL +resources.clusters.*.single_user_name string ALL +resources.clusters.*.spark_conf map[string]string ALL +resources.clusters.*.spark_conf.* string ALL +resources.clusters.*.spark_context_id int64 REMOTE +resources.clusters.*.spark_env_vars map[string]string ALL +resources.clusters.*.spark_env_vars.* string ALL +resources.clusters.*.spark_version string ALL +resources.clusters.*.spec *compute.ClusterSpec REMOTE +resources.clusters.*.spec.apply_policy_default_values bool REMOTE +resources.clusters.*.spec.autoscale *compute.AutoScale REMOTE +resources.clusters.*.spec.autoscale.max_workers int REMOTE +resources.clusters.*.spec.autoscale.min_workers int REMOTE +resources.clusters.*.spec.autotermination_minutes int REMOTE +resources.clusters.*.spec.aws_attributes *compute.AwsAttributes REMOTE +resources.clusters.*.spec.aws_attributes.availability compute.AwsAvailability REMOTE +resources.clusters.*.spec.aws_attributes.ebs_volume_count int REMOTE +resources.clusters.*.spec.aws_attributes.ebs_volume_iops int REMOTE +resources.clusters.*.spec.aws_attributes.ebs_volume_size int REMOTE +resources.clusters.*.spec.aws_attributes.ebs_volume_throughput int REMOTE +resources.clusters.*.spec.aws_attributes.ebs_volume_type compute.EbsVolumeType REMOTE +resources.clusters.*.spec.aws_attributes.first_on_demand int REMOTE +resources.clusters.*.spec.aws_attributes.instance_profile_arn string REMOTE +resources.clusters.*.spec.aws_attributes.spot_bid_price_percent int REMOTE +resources.clusters.*.spec.aws_attributes.zone_id string REMOTE +resources.clusters.*.spec.azure_attributes *compute.AzureAttributes REMOTE +resources.clusters.*.spec.azure_attributes.availability compute.AzureAvailability REMOTE +resources.clusters.*.spec.azure_attributes.first_on_demand int REMOTE +resources.clusters.*.spec.azure_attributes.log_analytics_info *compute.LogAnalyticsInfo REMOTE +resources.clusters.*.spec.azure_attributes.log_analytics_info.log_analytics_primary_key string REMOTE +resources.clusters.*.spec.azure_attributes.log_analytics_info.log_analytics_workspace_id string REMOTE +resources.clusters.*.spec.azure_attributes.spot_bid_max_price float64 REMOTE +resources.clusters.*.spec.cluster_log_conf *compute.ClusterLogConf REMOTE +resources.clusters.*.spec.cluster_log_conf.dbfs *compute.DbfsStorageInfo REMOTE +resources.clusters.*.spec.cluster_log_conf.dbfs.destination string REMOTE +resources.clusters.*.spec.cluster_log_conf.s3 *compute.S3StorageInfo REMOTE +resources.clusters.*.spec.cluster_log_conf.s3.canned_acl string REMOTE +resources.clusters.*.spec.cluster_log_conf.s3.destination string REMOTE +resources.clusters.*.spec.cluster_log_conf.s3.enable_encryption bool REMOTE +resources.clusters.*.spec.cluster_log_conf.s3.encryption_type string REMOTE +resources.clusters.*.spec.cluster_log_conf.s3.endpoint string REMOTE +resources.clusters.*.spec.cluster_log_conf.s3.kms_key string REMOTE +resources.clusters.*.spec.cluster_log_conf.s3.region string REMOTE +resources.clusters.*.spec.cluster_log_conf.volumes *compute.VolumesStorageInfo REMOTE +resources.clusters.*.spec.cluster_log_conf.volumes.destination string REMOTE +resources.clusters.*.spec.cluster_name string REMOTE +resources.clusters.*.spec.custom_tags map[string]string REMOTE +resources.clusters.*.spec.custom_tags.* string REMOTE +resources.clusters.*.spec.data_security_mode compute.DataSecurityMode REMOTE +resources.clusters.*.spec.docker_image *compute.DockerImage REMOTE +resources.clusters.*.spec.docker_image.basic_auth *compute.DockerBasicAuth REMOTE +resources.clusters.*.spec.docker_image.basic_auth.password string REMOTE +resources.clusters.*.spec.docker_image.basic_auth.username string REMOTE +resources.clusters.*.spec.docker_image.url string REMOTE +resources.clusters.*.spec.driver_instance_pool_id string REMOTE +resources.clusters.*.spec.driver_node_type_flexibility *compute.NodeTypeFlexibility REMOTE +resources.clusters.*.spec.driver_node_type_flexibility.alternate_node_type_ids []string REMOTE +resources.clusters.*.spec.driver_node_type_flexibility.alternate_node_type_ids[*] string REMOTE +resources.clusters.*.spec.driver_node_type_id string REMOTE +resources.clusters.*.spec.enable_elastic_disk bool REMOTE +resources.clusters.*.spec.enable_local_disk_encryption bool REMOTE +resources.clusters.*.spec.gcp_attributes *compute.GcpAttributes REMOTE +resources.clusters.*.spec.gcp_attributes.availability compute.GcpAvailability REMOTE +resources.clusters.*.spec.gcp_attributes.boot_disk_size int REMOTE +resources.clusters.*.spec.gcp_attributes.confidential_compute_type compute.ConfidentialComputeType REMOTE +resources.clusters.*.spec.gcp_attributes.first_on_demand int REMOTE +resources.clusters.*.spec.gcp_attributes.google_service_account string REMOTE +resources.clusters.*.spec.gcp_attributes.local_ssd_count int REMOTE +resources.clusters.*.spec.gcp_attributes.use_preemptible_executors bool REMOTE +resources.clusters.*.spec.gcp_attributes.zone_id string REMOTE +resources.clusters.*.spec.init_scripts []compute.InitScriptInfo REMOTE +resources.clusters.*.spec.init_scripts[*] compute.InitScriptInfo REMOTE +resources.clusters.*.spec.init_scripts[*].abfss *compute.Adlsgen2Info REMOTE +resources.clusters.*.spec.init_scripts[*].abfss.destination string REMOTE +resources.clusters.*.spec.init_scripts[*].dbfs *compute.DbfsStorageInfo REMOTE +resources.clusters.*.spec.init_scripts[*].dbfs.destination string REMOTE +resources.clusters.*.spec.init_scripts[*].file *compute.LocalFileInfo REMOTE +resources.clusters.*.spec.init_scripts[*].file.destination string REMOTE +resources.clusters.*.spec.init_scripts[*].gcs *compute.GcsStorageInfo REMOTE +resources.clusters.*.spec.init_scripts[*].gcs.destination string REMOTE +resources.clusters.*.spec.init_scripts[*].s3 *compute.S3StorageInfo REMOTE +resources.clusters.*.spec.init_scripts[*].s3.canned_acl string REMOTE +resources.clusters.*.spec.init_scripts[*].s3.destination string REMOTE +resources.clusters.*.spec.init_scripts[*].s3.enable_encryption bool REMOTE +resources.clusters.*.spec.init_scripts[*].s3.encryption_type string REMOTE +resources.clusters.*.spec.init_scripts[*].s3.endpoint string REMOTE +resources.clusters.*.spec.init_scripts[*].s3.kms_key string REMOTE +resources.clusters.*.spec.init_scripts[*].s3.region string REMOTE +resources.clusters.*.spec.init_scripts[*].volumes *compute.VolumesStorageInfo REMOTE +resources.clusters.*.spec.init_scripts[*].volumes.destination string REMOTE +resources.clusters.*.spec.init_scripts[*].workspace *compute.WorkspaceStorageInfo REMOTE +resources.clusters.*.spec.init_scripts[*].workspace.destination string REMOTE +resources.clusters.*.spec.instance_pool_id string REMOTE +resources.clusters.*.spec.is_single_node bool REMOTE +resources.clusters.*.spec.kind compute.Kind REMOTE +resources.clusters.*.spec.node_type_id string REMOTE +resources.clusters.*.spec.num_workers int REMOTE +resources.clusters.*.spec.policy_id string REMOTE +resources.clusters.*.spec.remote_disk_throughput int REMOTE +resources.clusters.*.spec.runtime_engine compute.RuntimeEngine REMOTE +resources.clusters.*.spec.single_user_name string REMOTE +resources.clusters.*.spec.spark_conf map[string]string REMOTE +resources.clusters.*.spec.spark_conf.* string REMOTE +resources.clusters.*.spec.spark_env_vars map[string]string REMOTE +resources.clusters.*.spec.spark_env_vars.* string REMOTE +resources.clusters.*.spec.spark_version string REMOTE +resources.clusters.*.spec.ssh_public_keys []string REMOTE +resources.clusters.*.spec.ssh_public_keys[*] string REMOTE +resources.clusters.*.spec.total_initial_remote_disk_size int REMOTE +resources.clusters.*.spec.use_ml_runtime bool REMOTE +resources.clusters.*.spec.worker_node_type_flexibility *compute.NodeTypeFlexibility REMOTE +resources.clusters.*.spec.worker_node_type_flexibility.alternate_node_type_ids []string REMOTE +resources.clusters.*.spec.worker_node_type_flexibility.alternate_node_type_ids[*] string REMOTE +resources.clusters.*.spec.workload_type *compute.WorkloadType REMOTE +resources.clusters.*.spec.workload_type.clients compute.ClientsTypes REMOTE +resources.clusters.*.spec.workload_type.clients.jobs bool REMOTE +resources.clusters.*.spec.workload_type.clients.notebooks bool REMOTE +resources.clusters.*.ssh_public_keys []string ALL +resources.clusters.*.ssh_public_keys[*] string ALL +resources.clusters.*.start_time int64 REMOTE +resources.clusters.*.state compute.State REMOTE +resources.clusters.*.state_message string REMOTE +resources.clusters.*.terminated_time int64 REMOTE +resources.clusters.*.termination_reason *compute.TerminationReason REMOTE +resources.clusters.*.termination_reason.code compute.TerminationReasonCode REMOTE +resources.clusters.*.termination_reason.parameters map[string]string REMOTE +resources.clusters.*.termination_reason.parameters.* string REMOTE +resources.clusters.*.termination_reason.type compute.TerminationReasonType REMOTE +resources.clusters.*.total_initial_remote_disk_size int ALL +resources.clusters.*.url string INPUT +resources.clusters.*.use_ml_runtime bool ALL +resources.clusters.*.worker_node_type_flexibility *compute.NodeTypeFlexibility ALL +resources.clusters.*.worker_node_type_flexibility.alternate_node_type_ids []string ALL +resources.clusters.*.worker_node_type_flexibility.alternate_node_type_ids[*] string ALL +resources.clusters.*.workload_type *compute.WorkloadType ALL +resources.clusters.*.workload_type.clients compute.ClientsTypes ALL +resources.clusters.*.workload_type.clients.jobs bool ALL +resources.clusters.*.workload_type.clients.notebooks bool ALL +resources.clusters.*.permissions.object_id string ALL +resources.clusters.*.permissions[*] dresources.StatePermission ALL +resources.clusters.*.permissions[*].group_name string ALL +resources.clusters.*.permissions[*].level iam.PermissionLevel ALL +resources.clusters.*.permissions[*].service_principal_name string ALL +resources.clusters.*.permissions[*].user_name string ALL +resources.dashboards.*.create_time string ALL +resources.dashboards.*.dashboard_id string ALL +resources.dashboards.*.dataset_catalog string ALL +resources.dashboards.*.dataset_schema string ALL +resources.dashboards.*.display_name string ALL +resources.dashboards.*.embed_credentials bool ALL +resources.dashboards.*.etag string ALL +resources.dashboards.*.file_path string INPUT +resources.dashboards.*.id string INPUT +resources.dashboards.*.lifecycle resources.Lifecycle INPUT +resources.dashboards.*.lifecycle.prevent_destroy bool INPUT +resources.dashboards.*.lifecycle_state dashboards.LifecycleState ALL +resources.dashboards.*.modified_status string INPUT +resources.dashboards.*.parent_path string ALL +resources.dashboards.*.path string ALL +resources.dashboards.*.published bool REMOTE STATE +resources.dashboards.*.serialized_dashboard any ALL +resources.dashboards.*.update_time string ALL +resources.dashboards.*.url string INPUT +resources.dashboards.*.warehouse_id string ALL +resources.dashboards.*.permissions.object_id string ALL +resources.dashboards.*.permissions[*] dresources.StatePermission ALL +resources.dashboards.*.permissions[*].group_name string ALL +resources.dashboards.*.permissions[*].level iam.PermissionLevel ALL +resources.dashboards.*.permissions[*].service_principal_name string ALL +resources.dashboards.*.permissions[*].user_name string ALL +resources.database_catalogs.*.create_database_if_not_exists bool ALL +resources.database_catalogs.*.database_instance_name string ALL +resources.database_catalogs.*.database_name string ALL +resources.database_catalogs.*.id string INPUT +resources.database_catalogs.*.lifecycle resources.Lifecycle INPUT +resources.database_catalogs.*.lifecycle.prevent_destroy bool INPUT +resources.database_catalogs.*.modified_status string INPUT +resources.database_catalogs.*.name string ALL +resources.database_catalogs.*.uid string ALL +resources.database_catalogs.*.url string INPUT +resources.database_instances.*.capacity string ALL +resources.database_instances.*.child_instance_refs []database.DatabaseInstanceRef ALL +resources.database_instances.*.child_instance_refs[*] database.DatabaseInstanceRef ALL +resources.database_instances.*.child_instance_refs[*].branch_time string ALL +resources.database_instances.*.child_instance_refs[*].effective_lsn string ALL +resources.database_instances.*.child_instance_refs[*].lsn string ALL +resources.database_instances.*.child_instance_refs[*].name string ALL +resources.database_instances.*.child_instance_refs[*].uid string ALL +resources.database_instances.*.creation_time string ALL +resources.database_instances.*.creator string ALL +resources.database_instances.*.custom_tags []database.CustomTag ALL +resources.database_instances.*.custom_tags[*] database.CustomTag ALL +resources.database_instances.*.custom_tags[*].key string ALL +resources.database_instances.*.custom_tags[*].value string ALL +resources.database_instances.*.effective_capacity string ALL +resources.database_instances.*.effective_custom_tags []database.CustomTag ALL +resources.database_instances.*.effective_custom_tags[*] database.CustomTag ALL +resources.database_instances.*.effective_custom_tags[*].key string ALL +resources.database_instances.*.effective_custom_tags[*].value string ALL +resources.database_instances.*.effective_enable_pg_native_login bool ALL +resources.database_instances.*.effective_enable_readable_secondaries bool ALL +resources.database_instances.*.effective_node_count int ALL +resources.database_instances.*.effective_retention_window_in_days int ALL +resources.database_instances.*.effective_stopped bool ALL +resources.database_instances.*.effective_usage_policy_id string ALL +resources.database_instances.*.enable_pg_native_login bool ALL +resources.database_instances.*.enable_readable_secondaries bool ALL +resources.database_instances.*.id string INPUT +resources.database_instances.*.lifecycle resources.Lifecycle INPUT +resources.database_instances.*.lifecycle.prevent_destroy bool INPUT +resources.database_instances.*.modified_status string INPUT +resources.database_instances.*.name string ALL +resources.database_instances.*.node_count int ALL +resources.database_instances.*.parent_instance_ref *database.DatabaseInstanceRef ALL +resources.database_instances.*.parent_instance_ref.branch_time string ALL +resources.database_instances.*.parent_instance_ref.effective_lsn string ALL +resources.database_instances.*.parent_instance_ref.lsn string ALL +resources.database_instances.*.parent_instance_ref.name string ALL +resources.database_instances.*.parent_instance_ref.uid string ALL +resources.database_instances.*.pg_version string ALL +resources.database_instances.*.read_only_dns string ALL +resources.database_instances.*.read_write_dns string ALL +resources.database_instances.*.retention_window_in_days int ALL +resources.database_instances.*.state database.DatabaseInstanceState ALL +resources.database_instances.*.stopped bool ALL +resources.database_instances.*.uid string ALL +resources.database_instances.*.url string INPUT +resources.database_instances.*.usage_policy_id string ALL +resources.database_instances.*.permissions.object_id string ALL +resources.database_instances.*.permissions[*] dresources.StatePermission ALL +resources.database_instances.*.permissions[*].group_name string ALL +resources.database_instances.*.permissions[*].level iam.PermissionLevel ALL +resources.database_instances.*.permissions[*].service_principal_name string ALL +resources.database_instances.*.permissions[*].user_name string ALL +resources.experiments.*.artifact_location string ALL +resources.experiments.*.creation_time int64 REMOTE +resources.experiments.*.experiment_id string REMOTE +resources.experiments.*.id string INPUT +resources.experiments.*.last_update_time int64 REMOTE +resources.experiments.*.lifecycle resources.Lifecycle INPUT +resources.experiments.*.lifecycle.prevent_destroy bool INPUT +resources.experiments.*.lifecycle_stage string REMOTE +resources.experiments.*.modified_status string INPUT +resources.experiments.*.name string ALL +resources.experiments.*.tags []ml.ExperimentTag ALL +resources.experiments.*.tags[*] ml.ExperimentTag ALL +resources.experiments.*.tags[*].key string ALL +resources.experiments.*.tags[*].value string ALL +resources.experiments.*.url string INPUT +resources.experiments.*.permissions.object_id string ALL +resources.experiments.*.permissions[*] dresources.StatePermission ALL +resources.experiments.*.permissions[*].group_name string ALL +resources.experiments.*.permissions[*].level iam.PermissionLevel ALL +resources.experiments.*.permissions[*].service_principal_name string ALL +resources.experiments.*.permissions[*].user_name string ALL +resources.external_locations.*.browse_only bool REMOTE +resources.external_locations.*.comment string ALL +resources.external_locations.*.created_at int64 REMOTE +resources.external_locations.*.created_by string REMOTE +resources.external_locations.*.credential_id string REMOTE +resources.external_locations.*.credential_name string ALL +resources.external_locations.*.effective_enable_file_events bool ALL +resources.external_locations.*.effective_file_event_queue *catalog.FileEventQueue ALL +resources.external_locations.*.effective_file_event_queue.managed_aqs *catalog.AzureQueueStorage ALL +resources.external_locations.*.effective_file_event_queue.managed_aqs.managed_resource_id string ALL +resources.external_locations.*.effective_file_event_queue.managed_aqs.queue_url string ALL +resources.external_locations.*.effective_file_event_queue.managed_aqs.resource_group string ALL +resources.external_locations.*.effective_file_event_queue.managed_aqs.subscription_id string ALL +resources.external_locations.*.effective_file_event_queue.managed_pubsub *catalog.GcpPubsub ALL +resources.external_locations.*.effective_file_event_queue.managed_pubsub.managed_resource_id string ALL +resources.external_locations.*.effective_file_event_queue.managed_pubsub.subscription_name string ALL +resources.external_locations.*.effective_file_event_queue.managed_sqs *catalog.AwsSqsQueue ALL +resources.external_locations.*.effective_file_event_queue.managed_sqs.managed_resource_id string ALL +resources.external_locations.*.effective_file_event_queue.managed_sqs.queue_url string ALL +resources.external_locations.*.effective_file_event_queue.provided_aqs *catalog.AzureQueueStorage ALL +resources.external_locations.*.effective_file_event_queue.provided_aqs.managed_resource_id string ALL +resources.external_locations.*.effective_file_event_queue.provided_aqs.queue_url string ALL +resources.external_locations.*.effective_file_event_queue.provided_aqs.resource_group string ALL +resources.external_locations.*.effective_file_event_queue.provided_aqs.subscription_id string ALL +resources.external_locations.*.effective_file_event_queue.provided_pubsub *catalog.GcpPubsub ALL +resources.external_locations.*.effective_file_event_queue.provided_pubsub.managed_resource_id string ALL +resources.external_locations.*.effective_file_event_queue.provided_pubsub.subscription_name string ALL +resources.external_locations.*.effective_file_event_queue.provided_sqs *catalog.AwsSqsQueue ALL +resources.external_locations.*.effective_file_event_queue.provided_sqs.managed_resource_id string ALL +resources.external_locations.*.effective_file_event_queue.provided_sqs.queue_url string ALL +resources.external_locations.*.enable_file_events bool ALL +resources.external_locations.*.encryption_details *catalog.EncryptionDetails ALL +resources.external_locations.*.encryption_details.sse_encryption_details *catalog.SseEncryptionDetails ALL +resources.external_locations.*.encryption_details.sse_encryption_details.algorithm catalog.SseEncryptionDetailsAlgorithm ALL +resources.external_locations.*.encryption_details.sse_encryption_details.aws_kms_key_arn string ALL +resources.external_locations.*.fallback bool ALL +resources.external_locations.*.file_event_queue *catalog.FileEventQueue ALL +resources.external_locations.*.file_event_queue.managed_aqs *catalog.AzureQueueStorage ALL +resources.external_locations.*.file_event_queue.managed_aqs.managed_resource_id string ALL +resources.external_locations.*.file_event_queue.managed_aqs.queue_url string ALL +resources.external_locations.*.file_event_queue.managed_aqs.resource_group string ALL +resources.external_locations.*.file_event_queue.managed_aqs.subscription_id string ALL +resources.external_locations.*.file_event_queue.managed_pubsub *catalog.GcpPubsub ALL +resources.external_locations.*.file_event_queue.managed_pubsub.managed_resource_id string ALL +resources.external_locations.*.file_event_queue.managed_pubsub.subscription_name string ALL +resources.external_locations.*.file_event_queue.managed_sqs *catalog.AwsSqsQueue ALL +resources.external_locations.*.file_event_queue.managed_sqs.managed_resource_id string ALL +resources.external_locations.*.file_event_queue.managed_sqs.queue_url string ALL +resources.external_locations.*.file_event_queue.provided_aqs *catalog.AzureQueueStorage ALL +resources.external_locations.*.file_event_queue.provided_aqs.managed_resource_id string ALL +resources.external_locations.*.file_event_queue.provided_aqs.queue_url string ALL +resources.external_locations.*.file_event_queue.provided_aqs.resource_group string ALL +resources.external_locations.*.file_event_queue.provided_aqs.subscription_id string ALL +resources.external_locations.*.file_event_queue.provided_pubsub *catalog.GcpPubsub ALL +resources.external_locations.*.file_event_queue.provided_pubsub.managed_resource_id string ALL +resources.external_locations.*.file_event_queue.provided_pubsub.subscription_name string ALL +resources.external_locations.*.file_event_queue.provided_sqs *catalog.AwsSqsQueue ALL +resources.external_locations.*.file_event_queue.provided_sqs.managed_resource_id string ALL +resources.external_locations.*.file_event_queue.provided_sqs.queue_url string ALL +resources.external_locations.*.id string INPUT +resources.external_locations.*.isolation_mode catalog.IsolationMode REMOTE +resources.external_locations.*.lifecycle resources.Lifecycle INPUT +resources.external_locations.*.lifecycle.prevent_destroy bool INPUT +resources.external_locations.*.metastore_id string REMOTE +resources.external_locations.*.modified_status string INPUT +resources.external_locations.*.name string ALL +resources.external_locations.*.owner string REMOTE +resources.external_locations.*.read_only bool ALL +resources.external_locations.*.skip_validation bool INPUT STATE +resources.external_locations.*.updated_at int64 REMOTE +resources.external_locations.*.updated_by string REMOTE +resources.external_locations.*.url string ALL +resources.external_locations.*.grants.full_name string ALL +resources.external_locations.*.grants.securable_type string ALL +resources.external_locations.*.grants[*] catalog.PrivilegeAssignment ALL +resources.external_locations.*.grants[*].principal string ALL +resources.external_locations.*.grants[*].privileges []catalog.Privilege ALL +resources.external_locations.*.grants[*].privileges[*] catalog.Privilege ALL +resources.jobs.*.budget_policy_id string ALL +resources.jobs.*.continuous *jobs.Continuous ALL +resources.jobs.*.continuous.pause_status jobs.PauseStatus ALL +resources.jobs.*.continuous.task_retry_mode jobs.TaskRetryMode ALL +resources.jobs.*.created_time int64 REMOTE +resources.jobs.*.creator_user_name string REMOTE +resources.jobs.*.deployment *jobs.JobDeployment ALL +resources.jobs.*.deployment.kind jobs.JobDeploymentKind ALL +resources.jobs.*.deployment.metadata_file_path string ALL +resources.jobs.*.description string ALL +resources.jobs.*.edit_mode jobs.JobEditMode ALL +resources.jobs.*.effective_budget_policy_id string REMOTE +resources.jobs.*.effective_usage_policy_id string REMOTE +resources.jobs.*.email_notifications *jobs.JobEmailNotifications ALL +resources.jobs.*.email_notifications.no_alert_for_skipped_runs bool ALL +resources.jobs.*.email_notifications.on_duration_warning_threshold_exceeded []string ALL +resources.jobs.*.email_notifications.on_duration_warning_threshold_exceeded[*] string ALL +resources.jobs.*.email_notifications.on_failure []string ALL +resources.jobs.*.email_notifications.on_failure[*] string ALL +resources.jobs.*.email_notifications.on_start []string ALL +resources.jobs.*.email_notifications.on_start[*] string ALL +resources.jobs.*.email_notifications.on_streaming_backlog_exceeded []string ALL +resources.jobs.*.email_notifications.on_streaming_backlog_exceeded[*] string ALL +resources.jobs.*.email_notifications.on_success []string ALL +resources.jobs.*.email_notifications.on_success[*] string ALL +resources.jobs.*.environments []jobs.JobEnvironment ALL +resources.jobs.*.environments[*] jobs.JobEnvironment ALL +resources.jobs.*.environments[*].environment_key string ALL +resources.jobs.*.environments[*].spec *compute.Environment ALL +resources.jobs.*.environments[*].spec.base_environment string ALL +resources.jobs.*.environments[*].spec.client string ALL +resources.jobs.*.environments[*].spec.dependencies []string ALL +resources.jobs.*.environments[*].spec.dependencies[*] string ALL +resources.jobs.*.environments[*].spec.environment_version string ALL +resources.jobs.*.environments[*].spec.java_dependencies []string ALL +resources.jobs.*.environments[*].spec.java_dependencies[*] string ALL +resources.jobs.*.format jobs.Format ALL +resources.jobs.*.git_source *jobs.GitSource ALL +resources.jobs.*.git_source.git_branch string ALL +resources.jobs.*.git_source.git_commit string ALL +resources.jobs.*.git_source.git_provider jobs.GitProvider ALL +resources.jobs.*.git_source.git_snapshot *jobs.GitSnapshot ALL +resources.jobs.*.git_source.git_snapshot.used_commit string ALL +resources.jobs.*.git_source.git_tag string ALL +resources.jobs.*.git_source.git_url string ALL +resources.jobs.*.git_source.job_source *jobs.JobSource ALL +resources.jobs.*.git_source.job_source.dirty_state jobs.JobSourceDirtyState ALL +resources.jobs.*.git_source.job_source.import_from_git_branch string ALL +resources.jobs.*.git_source.job_source.job_config_path string ALL +resources.jobs.*.git_source.sparse_checkout *jobs.SparseCheckout ALL +resources.jobs.*.git_source.sparse_checkout.patterns []string ALL +resources.jobs.*.git_source.sparse_checkout.patterns[*] string ALL +resources.jobs.*.health *jobs.JobsHealthRules ALL +resources.jobs.*.health.rules []jobs.JobsHealthRule ALL +resources.jobs.*.health.rules[*] jobs.JobsHealthRule ALL +resources.jobs.*.health.rules[*].metric jobs.JobsHealthMetric ALL +resources.jobs.*.health.rules[*].op jobs.JobsHealthOperator ALL +resources.jobs.*.health.rules[*].value int64 ALL +resources.jobs.*.id string INPUT +resources.jobs.*.job_clusters []jobs.JobCluster ALL +resources.jobs.*.job_clusters[*] jobs.JobCluster ALL +resources.jobs.*.job_clusters[*].job_cluster_key string ALL +resources.jobs.*.job_clusters[*].new_cluster compute.ClusterSpec ALL +resources.jobs.*.job_clusters[*].new_cluster.apply_policy_default_values bool ALL +resources.jobs.*.job_clusters[*].new_cluster.autoscale *compute.AutoScale ALL +resources.jobs.*.job_clusters[*].new_cluster.autoscale.max_workers int ALL +resources.jobs.*.job_clusters[*].new_cluster.autoscale.min_workers int ALL +resources.jobs.*.job_clusters[*].new_cluster.autotermination_minutes int ALL +resources.jobs.*.job_clusters[*].new_cluster.aws_attributes *compute.AwsAttributes ALL +resources.jobs.*.job_clusters[*].new_cluster.aws_attributes.availability compute.AwsAvailability ALL +resources.jobs.*.job_clusters[*].new_cluster.aws_attributes.ebs_volume_count int ALL +resources.jobs.*.job_clusters[*].new_cluster.aws_attributes.ebs_volume_iops int ALL +resources.jobs.*.job_clusters[*].new_cluster.aws_attributes.ebs_volume_size int ALL +resources.jobs.*.job_clusters[*].new_cluster.aws_attributes.ebs_volume_throughput int ALL +resources.jobs.*.job_clusters[*].new_cluster.aws_attributes.ebs_volume_type compute.EbsVolumeType ALL +resources.jobs.*.job_clusters[*].new_cluster.aws_attributes.first_on_demand int ALL +resources.jobs.*.job_clusters[*].new_cluster.aws_attributes.instance_profile_arn string ALL +resources.jobs.*.job_clusters[*].new_cluster.aws_attributes.spot_bid_price_percent int ALL +resources.jobs.*.job_clusters[*].new_cluster.aws_attributes.zone_id string ALL +resources.jobs.*.job_clusters[*].new_cluster.azure_attributes *compute.AzureAttributes ALL +resources.jobs.*.job_clusters[*].new_cluster.azure_attributes.availability compute.AzureAvailability ALL +resources.jobs.*.job_clusters[*].new_cluster.azure_attributes.first_on_demand int ALL +resources.jobs.*.job_clusters[*].new_cluster.azure_attributes.log_analytics_info *compute.LogAnalyticsInfo ALL +resources.jobs.*.job_clusters[*].new_cluster.azure_attributes.log_analytics_info.log_analytics_primary_key string ALL +resources.jobs.*.job_clusters[*].new_cluster.azure_attributes.log_analytics_info.log_analytics_workspace_id string ALL +resources.jobs.*.job_clusters[*].new_cluster.azure_attributes.spot_bid_max_price float64 ALL +resources.jobs.*.job_clusters[*].new_cluster.cluster_log_conf *compute.ClusterLogConf ALL +resources.jobs.*.job_clusters[*].new_cluster.cluster_log_conf.dbfs *compute.DbfsStorageInfo ALL +resources.jobs.*.job_clusters[*].new_cluster.cluster_log_conf.dbfs.destination string ALL +resources.jobs.*.job_clusters[*].new_cluster.cluster_log_conf.s3 *compute.S3StorageInfo ALL +resources.jobs.*.job_clusters[*].new_cluster.cluster_log_conf.s3.canned_acl string ALL +resources.jobs.*.job_clusters[*].new_cluster.cluster_log_conf.s3.destination string ALL +resources.jobs.*.job_clusters[*].new_cluster.cluster_log_conf.s3.enable_encryption bool ALL +resources.jobs.*.job_clusters[*].new_cluster.cluster_log_conf.s3.encryption_type string ALL +resources.jobs.*.job_clusters[*].new_cluster.cluster_log_conf.s3.endpoint string ALL +resources.jobs.*.job_clusters[*].new_cluster.cluster_log_conf.s3.kms_key string ALL +resources.jobs.*.job_clusters[*].new_cluster.cluster_log_conf.s3.region string ALL +resources.jobs.*.job_clusters[*].new_cluster.cluster_log_conf.volumes *compute.VolumesStorageInfo ALL +resources.jobs.*.job_clusters[*].new_cluster.cluster_log_conf.volumes.destination string ALL +resources.jobs.*.job_clusters[*].new_cluster.cluster_name string ALL +resources.jobs.*.job_clusters[*].new_cluster.custom_tags map[string]string ALL +resources.jobs.*.job_clusters[*].new_cluster.custom_tags.* string ALL +resources.jobs.*.job_clusters[*].new_cluster.data_security_mode compute.DataSecurityMode ALL +resources.jobs.*.job_clusters[*].new_cluster.docker_image *compute.DockerImage ALL +resources.jobs.*.job_clusters[*].new_cluster.docker_image.basic_auth *compute.DockerBasicAuth ALL +resources.jobs.*.job_clusters[*].new_cluster.docker_image.basic_auth.password string ALL +resources.jobs.*.job_clusters[*].new_cluster.docker_image.basic_auth.username string ALL +resources.jobs.*.job_clusters[*].new_cluster.docker_image.url string ALL +resources.jobs.*.job_clusters[*].new_cluster.driver_instance_pool_id string ALL +resources.jobs.*.job_clusters[*].new_cluster.driver_node_type_flexibility *compute.NodeTypeFlexibility ALL +resources.jobs.*.job_clusters[*].new_cluster.driver_node_type_flexibility.alternate_node_type_ids []string ALL +resources.jobs.*.job_clusters[*].new_cluster.driver_node_type_flexibility.alternate_node_type_ids[*] string ALL +resources.jobs.*.job_clusters[*].new_cluster.driver_node_type_id string ALL +resources.jobs.*.job_clusters[*].new_cluster.enable_elastic_disk bool ALL +resources.jobs.*.job_clusters[*].new_cluster.enable_local_disk_encryption bool ALL +resources.jobs.*.job_clusters[*].new_cluster.gcp_attributes *compute.GcpAttributes ALL +resources.jobs.*.job_clusters[*].new_cluster.gcp_attributes.availability compute.GcpAvailability ALL +resources.jobs.*.job_clusters[*].new_cluster.gcp_attributes.boot_disk_size int ALL +resources.jobs.*.job_clusters[*].new_cluster.gcp_attributes.confidential_compute_type compute.ConfidentialComputeType ALL +resources.jobs.*.job_clusters[*].new_cluster.gcp_attributes.first_on_demand int ALL +resources.jobs.*.job_clusters[*].new_cluster.gcp_attributes.google_service_account string ALL +resources.jobs.*.job_clusters[*].new_cluster.gcp_attributes.local_ssd_count int ALL +resources.jobs.*.job_clusters[*].new_cluster.gcp_attributes.use_preemptible_executors bool ALL +resources.jobs.*.job_clusters[*].new_cluster.gcp_attributes.zone_id string ALL +resources.jobs.*.job_clusters[*].new_cluster.init_scripts []compute.InitScriptInfo ALL +resources.jobs.*.job_clusters[*].new_cluster.init_scripts[*] compute.InitScriptInfo ALL +resources.jobs.*.job_clusters[*].new_cluster.init_scripts[*].abfss *compute.Adlsgen2Info ALL +resources.jobs.*.job_clusters[*].new_cluster.init_scripts[*].abfss.destination string ALL +resources.jobs.*.job_clusters[*].new_cluster.init_scripts[*].dbfs *compute.DbfsStorageInfo ALL +resources.jobs.*.job_clusters[*].new_cluster.init_scripts[*].dbfs.destination string ALL +resources.jobs.*.job_clusters[*].new_cluster.init_scripts[*].file *compute.LocalFileInfo ALL +resources.jobs.*.job_clusters[*].new_cluster.init_scripts[*].file.destination string ALL +resources.jobs.*.job_clusters[*].new_cluster.init_scripts[*].gcs *compute.GcsStorageInfo ALL +resources.jobs.*.job_clusters[*].new_cluster.init_scripts[*].gcs.destination string ALL +resources.jobs.*.job_clusters[*].new_cluster.init_scripts[*].s3 *compute.S3StorageInfo ALL +resources.jobs.*.job_clusters[*].new_cluster.init_scripts[*].s3.canned_acl string ALL +resources.jobs.*.job_clusters[*].new_cluster.init_scripts[*].s3.destination string ALL +resources.jobs.*.job_clusters[*].new_cluster.init_scripts[*].s3.enable_encryption bool ALL +resources.jobs.*.job_clusters[*].new_cluster.init_scripts[*].s3.encryption_type string ALL +resources.jobs.*.job_clusters[*].new_cluster.init_scripts[*].s3.endpoint string ALL +resources.jobs.*.job_clusters[*].new_cluster.init_scripts[*].s3.kms_key string ALL +resources.jobs.*.job_clusters[*].new_cluster.init_scripts[*].s3.region string ALL +resources.jobs.*.job_clusters[*].new_cluster.init_scripts[*].volumes *compute.VolumesStorageInfo ALL +resources.jobs.*.job_clusters[*].new_cluster.init_scripts[*].volumes.destination string ALL +resources.jobs.*.job_clusters[*].new_cluster.init_scripts[*].workspace *compute.WorkspaceStorageInfo ALL +resources.jobs.*.job_clusters[*].new_cluster.init_scripts[*].workspace.destination string ALL +resources.jobs.*.job_clusters[*].new_cluster.instance_pool_id string ALL +resources.jobs.*.job_clusters[*].new_cluster.is_single_node bool ALL +resources.jobs.*.job_clusters[*].new_cluster.kind compute.Kind ALL +resources.jobs.*.job_clusters[*].new_cluster.node_type_id string ALL +resources.jobs.*.job_clusters[*].new_cluster.num_workers int ALL +resources.jobs.*.job_clusters[*].new_cluster.policy_id string ALL +resources.jobs.*.job_clusters[*].new_cluster.remote_disk_throughput int ALL +resources.jobs.*.job_clusters[*].new_cluster.runtime_engine compute.RuntimeEngine ALL +resources.jobs.*.job_clusters[*].new_cluster.single_user_name string ALL +resources.jobs.*.job_clusters[*].new_cluster.spark_conf map[string]string ALL +resources.jobs.*.job_clusters[*].new_cluster.spark_conf.* string ALL +resources.jobs.*.job_clusters[*].new_cluster.spark_env_vars map[string]string ALL +resources.jobs.*.job_clusters[*].new_cluster.spark_env_vars.* string ALL +resources.jobs.*.job_clusters[*].new_cluster.spark_version string ALL +resources.jobs.*.job_clusters[*].new_cluster.ssh_public_keys []string ALL +resources.jobs.*.job_clusters[*].new_cluster.ssh_public_keys[*] string ALL +resources.jobs.*.job_clusters[*].new_cluster.total_initial_remote_disk_size int ALL +resources.jobs.*.job_clusters[*].new_cluster.use_ml_runtime bool ALL +resources.jobs.*.job_clusters[*].new_cluster.worker_node_type_flexibility *compute.NodeTypeFlexibility ALL +resources.jobs.*.job_clusters[*].new_cluster.worker_node_type_flexibility.alternate_node_type_ids []string ALL +resources.jobs.*.job_clusters[*].new_cluster.worker_node_type_flexibility.alternate_node_type_ids[*] string ALL +resources.jobs.*.job_clusters[*].new_cluster.workload_type *compute.WorkloadType ALL +resources.jobs.*.job_clusters[*].new_cluster.workload_type.clients compute.ClientsTypes ALL +resources.jobs.*.job_clusters[*].new_cluster.workload_type.clients.jobs bool ALL +resources.jobs.*.job_clusters[*].new_cluster.workload_type.clients.notebooks bool ALL +resources.jobs.*.job_id int64 REMOTE +resources.jobs.*.lifecycle resources.Lifecycle INPUT +resources.jobs.*.lifecycle.prevent_destroy bool INPUT +resources.jobs.*.max_concurrent_runs int ALL +resources.jobs.*.modified_status string INPUT +resources.jobs.*.name string ALL +resources.jobs.*.notification_settings *jobs.JobNotificationSettings ALL +resources.jobs.*.notification_settings.no_alert_for_canceled_runs bool ALL +resources.jobs.*.notification_settings.no_alert_for_skipped_runs bool ALL +resources.jobs.*.parameters []jobs.JobParameterDefinition ALL +resources.jobs.*.parameters[*] jobs.JobParameterDefinition ALL +resources.jobs.*.parameters[*].default string ALL +resources.jobs.*.parameters[*].name string ALL +resources.jobs.*.performance_target jobs.PerformanceTarget ALL +resources.jobs.*.queue *jobs.QueueSettings ALL +resources.jobs.*.queue.enabled bool ALL +resources.jobs.*.run_as *jobs.JobRunAs ALL +resources.jobs.*.run_as.group_name string ALL +resources.jobs.*.run_as.service_principal_name string ALL +resources.jobs.*.run_as.user_name string ALL +resources.jobs.*.run_as_user_name string REMOTE +resources.jobs.*.schedule *jobs.CronSchedule ALL +resources.jobs.*.schedule.pause_status jobs.PauseStatus ALL +resources.jobs.*.schedule.quartz_cron_expression string ALL +resources.jobs.*.schedule.timezone_id string ALL +resources.jobs.*.tags map[string]string ALL +resources.jobs.*.tags.* string ALL +resources.jobs.*.tasks []jobs.Task ALL +resources.jobs.*.tasks[*] jobs.Task ALL +resources.jobs.*.tasks[*].alert_task *jobs.AlertTask ALL +resources.jobs.*.tasks[*].alert_task.alert_id string ALL +resources.jobs.*.tasks[*].alert_task.subscribers []jobs.AlertTaskSubscriber ALL +resources.jobs.*.tasks[*].alert_task.subscribers[*] jobs.AlertTaskSubscriber ALL +resources.jobs.*.tasks[*].alert_task.subscribers[*].destination_id string ALL +resources.jobs.*.tasks[*].alert_task.subscribers[*].user_name string ALL +resources.jobs.*.tasks[*].alert_task.warehouse_id string ALL +resources.jobs.*.tasks[*].alert_task.workspace_path string ALL +resources.jobs.*.tasks[*].clean_rooms_notebook_task *jobs.CleanRoomsNotebookTask ALL +resources.jobs.*.tasks[*].clean_rooms_notebook_task.clean_room_name string ALL +resources.jobs.*.tasks[*].clean_rooms_notebook_task.etag string ALL +resources.jobs.*.tasks[*].clean_rooms_notebook_task.notebook_base_parameters map[string]string ALL +resources.jobs.*.tasks[*].clean_rooms_notebook_task.notebook_base_parameters.* string ALL +resources.jobs.*.tasks[*].clean_rooms_notebook_task.notebook_name string ALL +resources.jobs.*.tasks[*].compute *jobs.Compute ALL +resources.jobs.*.tasks[*].compute.hardware_accelerator compute.HardwareAcceleratorType ALL +resources.jobs.*.tasks[*].condition_task *jobs.ConditionTask ALL +resources.jobs.*.tasks[*].condition_task.left string ALL +resources.jobs.*.tasks[*].condition_task.op jobs.ConditionTaskOp ALL +resources.jobs.*.tasks[*].condition_task.right string ALL +resources.jobs.*.tasks[*].dashboard_task *jobs.DashboardTask ALL +resources.jobs.*.tasks[*].dashboard_task.dashboard_id string ALL +resources.jobs.*.tasks[*].dashboard_task.filters map[string]string ALL +resources.jobs.*.tasks[*].dashboard_task.filters.* string ALL +resources.jobs.*.tasks[*].dashboard_task.subscription *jobs.Subscription ALL +resources.jobs.*.tasks[*].dashboard_task.subscription.custom_subject string ALL +resources.jobs.*.tasks[*].dashboard_task.subscription.paused bool ALL +resources.jobs.*.tasks[*].dashboard_task.subscription.subscribers []jobs.SubscriptionSubscriber ALL +resources.jobs.*.tasks[*].dashboard_task.subscription.subscribers[*] jobs.SubscriptionSubscriber ALL +resources.jobs.*.tasks[*].dashboard_task.subscription.subscribers[*].destination_id string ALL +resources.jobs.*.tasks[*].dashboard_task.subscription.subscribers[*].user_name string ALL +resources.jobs.*.tasks[*].dashboard_task.warehouse_id string ALL +resources.jobs.*.tasks[*].dbt_cloud_task *jobs.DbtCloudTask ALL +resources.jobs.*.tasks[*].dbt_cloud_task.connection_resource_name string ALL +resources.jobs.*.tasks[*].dbt_cloud_task.dbt_cloud_job_id int64 ALL +resources.jobs.*.tasks[*].dbt_platform_task *jobs.DbtPlatformTask ALL +resources.jobs.*.tasks[*].dbt_platform_task.connection_resource_name string ALL +resources.jobs.*.tasks[*].dbt_platform_task.dbt_platform_job_id string ALL +resources.jobs.*.tasks[*].dbt_task *jobs.DbtTask ALL +resources.jobs.*.tasks[*].dbt_task.catalog string ALL +resources.jobs.*.tasks[*].dbt_task.commands []string ALL +resources.jobs.*.tasks[*].dbt_task.commands[*] string ALL +resources.jobs.*.tasks[*].dbt_task.profiles_directory string ALL +resources.jobs.*.tasks[*].dbt_task.project_directory string ALL +resources.jobs.*.tasks[*].dbt_task.schema string ALL +resources.jobs.*.tasks[*].dbt_task.source jobs.Source ALL +resources.jobs.*.tasks[*].dbt_task.warehouse_id string ALL +resources.jobs.*.tasks[*].depends_on []jobs.TaskDependency ALL +resources.jobs.*.tasks[*].depends_on[*] jobs.TaskDependency ALL +resources.jobs.*.tasks[*].depends_on[*].outcome string ALL +resources.jobs.*.tasks[*].depends_on[*].task_key string ALL +resources.jobs.*.tasks[*].description string ALL +resources.jobs.*.tasks[*].disable_auto_optimization bool ALL +resources.jobs.*.tasks[*].disabled bool ALL +resources.jobs.*.tasks[*].email_notifications *jobs.TaskEmailNotifications ALL +resources.jobs.*.tasks[*].email_notifications.no_alert_for_skipped_runs bool ALL +resources.jobs.*.tasks[*].email_notifications.on_duration_warning_threshold_exceeded []string ALL +resources.jobs.*.tasks[*].email_notifications.on_duration_warning_threshold_exceeded[*] string ALL +resources.jobs.*.tasks[*].email_notifications.on_failure []string ALL +resources.jobs.*.tasks[*].email_notifications.on_failure[*] string ALL +resources.jobs.*.tasks[*].email_notifications.on_start []string ALL +resources.jobs.*.tasks[*].email_notifications.on_start[*] string ALL +resources.jobs.*.tasks[*].email_notifications.on_streaming_backlog_exceeded []string ALL +resources.jobs.*.tasks[*].email_notifications.on_streaming_backlog_exceeded[*] string ALL +resources.jobs.*.tasks[*].email_notifications.on_success []string ALL +resources.jobs.*.tasks[*].email_notifications.on_success[*] string ALL +resources.jobs.*.tasks[*].environment_key string ALL +resources.jobs.*.tasks[*].existing_cluster_id string ALL +resources.jobs.*.tasks[*].for_each_task *jobs.ForEachTask ALL +resources.jobs.*.tasks[*].for_each_task.concurrency int ALL +resources.jobs.*.tasks[*].for_each_task.inputs string ALL +resources.jobs.*.tasks[*].for_each_task.task jobs.Task ALL +resources.jobs.*.tasks[*].for_each_task.task.alert_task *jobs.AlertTask ALL +resources.jobs.*.tasks[*].for_each_task.task.alert_task.alert_id string ALL +resources.jobs.*.tasks[*].for_each_task.task.alert_task.subscribers []jobs.AlertTaskSubscriber ALL +resources.jobs.*.tasks[*].for_each_task.task.alert_task.subscribers[*] jobs.AlertTaskSubscriber ALL +resources.jobs.*.tasks[*].for_each_task.task.alert_task.subscribers[*].destination_id string ALL +resources.jobs.*.tasks[*].for_each_task.task.alert_task.subscribers[*].user_name string ALL +resources.jobs.*.tasks[*].for_each_task.task.alert_task.warehouse_id string ALL +resources.jobs.*.tasks[*].for_each_task.task.alert_task.workspace_path string ALL +resources.jobs.*.tasks[*].for_each_task.task.clean_rooms_notebook_task *jobs.CleanRoomsNotebookTask ALL +resources.jobs.*.tasks[*].for_each_task.task.clean_rooms_notebook_task.clean_room_name string ALL +resources.jobs.*.tasks[*].for_each_task.task.clean_rooms_notebook_task.etag string ALL +resources.jobs.*.tasks[*].for_each_task.task.clean_rooms_notebook_task.notebook_base_parameters map[string]string ALL +resources.jobs.*.tasks[*].for_each_task.task.clean_rooms_notebook_task.notebook_base_parameters.* string ALL +resources.jobs.*.tasks[*].for_each_task.task.clean_rooms_notebook_task.notebook_name string ALL +resources.jobs.*.tasks[*].for_each_task.task.compute *jobs.Compute ALL +resources.jobs.*.tasks[*].for_each_task.task.compute.hardware_accelerator compute.HardwareAcceleratorType ALL +resources.jobs.*.tasks[*].for_each_task.task.condition_task *jobs.ConditionTask ALL +resources.jobs.*.tasks[*].for_each_task.task.condition_task.left string ALL +resources.jobs.*.tasks[*].for_each_task.task.condition_task.op jobs.ConditionTaskOp ALL +resources.jobs.*.tasks[*].for_each_task.task.condition_task.right string ALL +resources.jobs.*.tasks[*].for_each_task.task.dashboard_task *jobs.DashboardTask ALL +resources.jobs.*.tasks[*].for_each_task.task.dashboard_task.dashboard_id string ALL +resources.jobs.*.tasks[*].for_each_task.task.dashboard_task.filters map[string]string ALL +resources.jobs.*.tasks[*].for_each_task.task.dashboard_task.filters.* string ALL +resources.jobs.*.tasks[*].for_each_task.task.dashboard_task.subscription *jobs.Subscription ALL +resources.jobs.*.tasks[*].for_each_task.task.dashboard_task.subscription.custom_subject string ALL +resources.jobs.*.tasks[*].for_each_task.task.dashboard_task.subscription.paused bool ALL +resources.jobs.*.tasks[*].for_each_task.task.dashboard_task.subscription.subscribers []jobs.SubscriptionSubscriber ALL +resources.jobs.*.tasks[*].for_each_task.task.dashboard_task.subscription.subscribers[*] jobs.SubscriptionSubscriber ALL +resources.jobs.*.tasks[*].for_each_task.task.dashboard_task.subscription.subscribers[*].destination_id string ALL +resources.jobs.*.tasks[*].for_each_task.task.dashboard_task.subscription.subscribers[*].user_name string ALL +resources.jobs.*.tasks[*].for_each_task.task.dashboard_task.warehouse_id string ALL +resources.jobs.*.tasks[*].for_each_task.task.dbt_cloud_task *jobs.DbtCloudTask ALL +resources.jobs.*.tasks[*].for_each_task.task.dbt_cloud_task.connection_resource_name string ALL +resources.jobs.*.tasks[*].for_each_task.task.dbt_cloud_task.dbt_cloud_job_id int64 ALL +resources.jobs.*.tasks[*].for_each_task.task.dbt_platform_task *jobs.DbtPlatformTask ALL +resources.jobs.*.tasks[*].for_each_task.task.dbt_platform_task.connection_resource_name string ALL +resources.jobs.*.tasks[*].for_each_task.task.dbt_platform_task.dbt_platform_job_id string ALL +resources.jobs.*.tasks[*].for_each_task.task.dbt_task *jobs.DbtTask ALL +resources.jobs.*.tasks[*].for_each_task.task.dbt_task.catalog string ALL +resources.jobs.*.tasks[*].for_each_task.task.dbt_task.commands []string ALL +resources.jobs.*.tasks[*].for_each_task.task.dbt_task.commands[*] string ALL +resources.jobs.*.tasks[*].for_each_task.task.dbt_task.profiles_directory string ALL +resources.jobs.*.tasks[*].for_each_task.task.dbt_task.project_directory string ALL +resources.jobs.*.tasks[*].for_each_task.task.dbt_task.schema string ALL +resources.jobs.*.tasks[*].for_each_task.task.dbt_task.source jobs.Source ALL +resources.jobs.*.tasks[*].for_each_task.task.dbt_task.warehouse_id string ALL +resources.jobs.*.tasks[*].for_each_task.task.depends_on []jobs.TaskDependency ALL +resources.jobs.*.tasks[*].for_each_task.task.depends_on[*] jobs.TaskDependency ALL +resources.jobs.*.tasks[*].for_each_task.task.depends_on[*].outcome string ALL +resources.jobs.*.tasks[*].for_each_task.task.depends_on[*].task_key string ALL +resources.jobs.*.tasks[*].for_each_task.task.description string ALL +resources.jobs.*.tasks[*].for_each_task.task.disable_auto_optimization bool ALL +resources.jobs.*.tasks[*].for_each_task.task.disabled bool ALL +resources.jobs.*.tasks[*].for_each_task.task.email_notifications *jobs.TaskEmailNotifications ALL +resources.jobs.*.tasks[*].for_each_task.task.email_notifications.no_alert_for_skipped_runs bool ALL +resources.jobs.*.tasks[*].for_each_task.task.email_notifications.on_duration_warning_threshold_exceeded []string ALL +resources.jobs.*.tasks[*].for_each_task.task.email_notifications.on_duration_warning_threshold_exceeded[*] string ALL +resources.jobs.*.tasks[*].for_each_task.task.email_notifications.on_failure []string ALL +resources.jobs.*.tasks[*].for_each_task.task.email_notifications.on_failure[*] string ALL +resources.jobs.*.tasks[*].for_each_task.task.email_notifications.on_start []string ALL +resources.jobs.*.tasks[*].for_each_task.task.email_notifications.on_start[*] string ALL +resources.jobs.*.tasks[*].for_each_task.task.email_notifications.on_streaming_backlog_exceeded []string ALL +resources.jobs.*.tasks[*].for_each_task.task.email_notifications.on_streaming_backlog_exceeded[*] string ALL +resources.jobs.*.tasks[*].for_each_task.task.email_notifications.on_success []string ALL +resources.jobs.*.tasks[*].for_each_task.task.email_notifications.on_success[*] string ALL +resources.jobs.*.tasks[*].for_each_task.task.environment_key string ALL +resources.jobs.*.tasks[*].for_each_task.task.existing_cluster_id string ALL +resources.jobs.*.tasks[*].for_each_task.task.for_each_task *jobs.ForEachTask ALL +resources.jobs.*.tasks[*].for_each_task.task.for_each_task.concurrency int ALL +resources.jobs.*.tasks[*].for_each_task.task.for_each_task.inputs string ALL +resources.jobs.*.tasks[*].for_each_task.task.for_each_task.task jobs.Task ALL +resources.jobs.*.tasks[*].for_each_task.task.gen_ai_compute_task *jobs.GenAiComputeTask ALL +resources.jobs.*.tasks[*].for_each_task.task.gen_ai_compute_task.command string ALL +resources.jobs.*.tasks[*].for_each_task.task.gen_ai_compute_task.compute *jobs.ComputeConfig ALL +resources.jobs.*.tasks[*].for_each_task.task.gen_ai_compute_task.compute.gpu_node_pool_id string ALL +resources.jobs.*.tasks[*].for_each_task.task.gen_ai_compute_task.compute.gpu_type string ALL +resources.jobs.*.tasks[*].for_each_task.task.gen_ai_compute_task.compute.num_gpus int ALL +resources.jobs.*.tasks[*].for_each_task.task.gen_ai_compute_task.dl_runtime_image string ALL +resources.jobs.*.tasks[*].for_each_task.task.gen_ai_compute_task.mlflow_experiment_name string ALL +resources.jobs.*.tasks[*].for_each_task.task.gen_ai_compute_task.source jobs.Source ALL +resources.jobs.*.tasks[*].for_each_task.task.gen_ai_compute_task.training_script_path string ALL +resources.jobs.*.tasks[*].for_each_task.task.gen_ai_compute_task.yaml_parameters string ALL +resources.jobs.*.tasks[*].for_each_task.task.gen_ai_compute_task.yaml_parameters_file_path string ALL +resources.jobs.*.tasks[*].for_each_task.task.health *jobs.JobsHealthRules ALL +resources.jobs.*.tasks[*].for_each_task.task.health.rules []jobs.JobsHealthRule ALL +resources.jobs.*.tasks[*].for_each_task.task.health.rules[*] jobs.JobsHealthRule ALL +resources.jobs.*.tasks[*].for_each_task.task.health.rules[*].metric jobs.JobsHealthMetric ALL +resources.jobs.*.tasks[*].for_each_task.task.health.rules[*].op jobs.JobsHealthOperator ALL +resources.jobs.*.tasks[*].for_each_task.task.health.rules[*].value int64 ALL +resources.jobs.*.tasks[*].for_each_task.task.job_cluster_key string ALL +resources.jobs.*.tasks[*].for_each_task.task.libraries []compute.Library ALL +resources.jobs.*.tasks[*].for_each_task.task.libraries[*] compute.Library ALL +resources.jobs.*.tasks[*].for_each_task.task.libraries[*].cran *compute.RCranLibrary ALL +resources.jobs.*.tasks[*].for_each_task.task.libraries[*].cran.package string ALL +resources.jobs.*.tasks[*].for_each_task.task.libraries[*].cran.repo string ALL +resources.jobs.*.tasks[*].for_each_task.task.libraries[*].egg string ALL +resources.jobs.*.tasks[*].for_each_task.task.libraries[*].jar string ALL +resources.jobs.*.tasks[*].for_each_task.task.libraries[*].maven *compute.MavenLibrary ALL +resources.jobs.*.tasks[*].for_each_task.task.libraries[*].maven.coordinates string ALL +resources.jobs.*.tasks[*].for_each_task.task.libraries[*].maven.exclusions []string ALL +resources.jobs.*.tasks[*].for_each_task.task.libraries[*].maven.exclusions[*] string ALL +resources.jobs.*.tasks[*].for_each_task.task.libraries[*].maven.repo string ALL +resources.jobs.*.tasks[*].for_each_task.task.libraries[*].pypi *compute.PythonPyPiLibrary ALL +resources.jobs.*.tasks[*].for_each_task.task.libraries[*].pypi.package string ALL +resources.jobs.*.tasks[*].for_each_task.task.libraries[*].pypi.repo string ALL +resources.jobs.*.tasks[*].for_each_task.task.libraries[*].requirements string ALL +resources.jobs.*.tasks[*].for_each_task.task.libraries[*].whl string ALL +resources.jobs.*.tasks[*].for_each_task.task.max_retries int ALL +resources.jobs.*.tasks[*].for_each_task.task.min_retry_interval_millis int ALL +resources.jobs.*.tasks[*].for_each_task.task.new_cluster *compute.ClusterSpec ALL +resources.jobs.*.tasks[*].for_each_task.task.new_cluster.apply_policy_default_values bool ALL +resources.jobs.*.tasks[*].for_each_task.task.new_cluster.autoscale *compute.AutoScale ALL +resources.jobs.*.tasks[*].for_each_task.task.new_cluster.autoscale.max_workers int ALL +resources.jobs.*.tasks[*].for_each_task.task.new_cluster.autoscale.min_workers int ALL +resources.jobs.*.tasks[*].for_each_task.task.new_cluster.autotermination_minutes int ALL +resources.jobs.*.tasks[*].for_each_task.task.new_cluster.aws_attributes *compute.AwsAttributes ALL +resources.jobs.*.tasks[*].for_each_task.task.new_cluster.aws_attributes.availability compute.AwsAvailability ALL +resources.jobs.*.tasks[*].for_each_task.task.new_cluster.aws_attributes.ebs_volume_count int ALL +resources.jobs.*.tasks[*].for_each_task.task.new_cluster.aws_attributes.ebs_volume_iops int ALL +resources.jobs.*.tasks[*].for_each_task.task.new_cluster.aws_attributes.ebs_volume_size int ALL +resources.jobs.*.tasks[*].for_each_task.task.new_cluster.aws_attributes.ebs_volume_throughput int ALL +resources.jobs.*.tasks[*].for_each_task.task.new_cluster.aws_attributes.ebs_volume_type compute.EbsVolumeType ALL +resources.jobs.*.tasks[*].for_each_task.task.new_cluster.aws_attributes.first_on_demand int ALL +resources.jobs.*.tasks[*].for_each_task.task.new_cluster.aws_attributes.instance_profile_arn string ALL +resources.jobs.*.tasks[*].for_each_task.task.new_cluster.aws_attributes.spot_bid_price_percent int ALL +resources.jobs.*.tasks[*].for_each_task.task.new_cluster.aws_attributes.zone_id string ALL +resources.jobs.*.tasks[*].for_each_task.task.new_cluster.azure_attributes *compute.AzureAttributes ALL +resources.jobs.*.tasks[*].for_each_task.task.new_cluster.azure_attributes.availability compute.AzureAvailability ALL +resources.jobs.*.tasks[*].for_each_task.task.new_cluster.azure_attributes.first_on_demand int ALL +resources.jobs.*.tasks[*].for_each_task.task.new_cluster.azure_attributes.log_analytics_info *compute.LogAnalyticsInfo ALL +resources.jobs.*.tasks[*].for_each_task.task.new_cluster.azure_attributes.log_analytics_info.log_analytics_primary_key string ALL +resources.jobs.*.tasks[*].for_each_task.task.new_cluster.azure_attributes.log_analytics_info.log_analytics_workspace_id string ALL +resources.jobs.*.tasks[*].for_each_task.task.new_cluster.azure_attributes.spot_bid_max_price float64 ALL +resources.jobs.*.tasks[*].for_each_task.task.new_cluster.cluster_log_conf *compute.ClusterLogConf ALL +resources.jobs.*.tasks[*].for_each_task.task.new_cluster.cluster_log_conf.dbfs *compute.DbfsStorageInfo ALL +resources.jobs.*.tasks[*].for_each_task.task.new_cluster.cluster_log_conf.dbfs.destination string ALL +resources.jobs.*.tasks[*].for_each_task.task.new_cluster.cluster_log_conf.s3 *compute.S3StorageInfo ALL +resources.jobs.*.tasks[*].for_each_task.task.new_cluster.cluster_log_conf.s3.canned_acl string ALL +resources.jobs.*.tasks[*].for_each_task.task.new_cluster.cluster_log_conf.s3.destination string ALL +resources.jobs.*.tasks[*].for_each_task.task.new_cluster.cluster_log_conf.s3.enable_encryption bool ALL +resources.jobs.*.tasks[*].for_each_task.task.new_cluster.cluster_log_conf.s3.encryption_type string ALL +resources.jobs.*.tasks[*].for_each_task.task.new_cluster.cluster_log_conf.s3.endpoint string ALL +resources.jobs.*.tasks[*].for_each_task.task.new_cluster.cluster_log_conf.s3.kms_key string ALL +resources.jobs.*.tasks[*].for_each_task.task.new_cluster.cluster_log_conf.s3.region string ALL +resources.jobs.*.tasks[*].for_each_task.task.new_cluster.cluster_log_conf.volumes *compute.VolumesStorageInfo ALL +resources.jobs.*.tasks[*].for_each_task.task.new_cluster.cluster_log_conf.volumes.destination string ALL +resources.jobs.*.tasks[*].for_each_task.task.new_cluster.cluster_name string ALL +resources.jobs.*.tasks[*].for_each_task.task.new_cluster.custom_tags map[string]string ALL +resources.jobs.*.tasks[*].for_each_task.task.new_cluster.custom_tags.* string ALL +resources.jobs.*.tasks[*].for_each_task.task.new_cluster.data_security_mode compute.DataSecurityMode ALL +resources.jobs.*.tasks[*].for_each_task.task.new_cluster.docker_image *compute.DockerImage ALL +resources.jobs.*.tasks[*].for_each_task.task.new_cluster.docker_image.basic_auth *compute.DockerBasicAuth ALL +resources.jobs.*.tasks[*].for_each_task.task.new_cluster.docker_image.basic_auth.password string ALL +resources.jobs.*.tasks[*].for_each_task.task.new_cluster.docker_image.basic_auth.username string ALL +resources.jobs.*.tasks[*].for_each_task.task.new_cluster.docker_image.url string ALL +resources.jobs.*.tasks[*].for_each_task.task.new_cluster.driver_instance_pool_id string ALL +resources.jobs.*.tasks[*].for_each_task.task.new_cluster.driver_node_type_flexibility *compute.NodeTypeFlexibility ALL +resources.jobs.*.tasks[*].for_each_task.task.new_cluster.driver_node_type_flexibility.alternate_node_type_ids []string ALL +resources.jobs.*.tasks[*].for_each_task.task.new_cluster.driver_node_type_flexibility.alternate_node_type_ids[*] string ALL +resources.jobs.*.tasks[*].for_each_task.task.new_cluster.driver_node_type_id string ALL +resources.jobs.*.tasks[*].for_each_task.task.new_cluster.enable_elastic_disk bool ALL +resources.jobs.*.tasks[*].for_each_task.task.new_cluster.enable_local_disk_encryption bool ALL +resources.jobs.*.tasks[*].for_each_task.task.new_cluster.gcp_attributes *compute.GcpAttributes ALL +resources.jobs.*.tasks[*].for_each_task.task.new_cluster.gcp_attributes.availability compute.GcpAvailability ALL +resources.jobs.*.tasks[*].for_each_task.task.new_cluster.gcp_attributes.boot_disk_size int ALL +resources.jobs.*.tasks[*].for_each_task.task.new_cluster.gcp_attributes.confidential_compute_type compute.ConfidentialComputeType ALL +resources.jobs.*.tasks[*].for_each_task.task.new_cluster.gcp_attributes.first_on_demand int ALL +resources.jobs.*.tasks[*].for_each_task.task.new_cluster.gcp_attributes.google_service_account string ALL +resources.jobs.*.tasks[*].for_each_task.task.new_cluster.gcp_attributes.local_ssd_count int ALL +resources.jobs.*.tasks[*].for_each_task.task.new_cluster.gcp_attributes.use_preemptible_executors bool ALL +resources.jobs.*.tasks[*].for_each_task.task.new_cluster.gcp_attributes.zone_id string ALL +resources.jobs.*.tasks[*].for_each_task.task.new_cluster.init_scripts []compute.InitScriptInfo ALL +resources.jobs.*.tasks[*].for_each_task.task.new_cluster.init_scripts[*] compute.InitScriptInfo ALL +resources.jobs.*.tasks[*].for_each_task.task.new_cluster.init_scripts[*].abfss *compute.Adlsgen2Info ALL +resources.jobs.*.tasks[*].for_each_task.task.new_cluster.init_scripts[*].abfss.destination string ALL +resources.jobs.*.tasks[*].for_each_task.task.new_cluster.init_scripts[*].dbfs *compute.DbfsStorageInfo ALL +resources.jobs.*.tasks[*].for_each_task.task.new_cluster.init_scripts[*].dbfs.destination string ALL +resources.jobs.*.tasks[*].for_each_task.task.new_cluster.init_scripts[*].file *compute.LocalFileInfo ALL +resources.jobs.*.tasks[*].for_each_task.task.new_cluster.init_scripts[*].file.destination string ALL +resources.jobs.*.tasks[*].for_each_task.task.new_cluster.init_scripts[*].gcs *compute.GcsStorageInfo ALL +resources.jobs.*.tasks[*].for_each_task.task.new_cluster.init_scripts[*].gcs.destination string ALL +resources.jobs.*.tasks[*].for_each_task.task.new_cluster.init_scripts[*].s3 *compute.S3StorageInfo ALL +resources.jobs.*.tasks[*].for_each_task.task.new_cluster.init_scripts[*].s3.canned_acl string ALL +resources.jobs.*.tasks[*].for_each_task.task.new_cluster.init_scripts[*].s3.destination string ALL +resources.jobs.*.tasks[*].for_each_task.task.new_cluster.init_scripts[*].s3.enable_encryption bool ALL +resources.jobs.*.tasks[*].for_each_task.task.new_cluster.init_scripts[*].s3.encryption_type string ALL +resources.jobs.*.tasks[*].for_each_task.task.new_cluster.init_scripts[*].s3.endpoint string ALL +resources.jobs.*.tasks[*].for_each_task.task.new_cluster.init_scripts[*].s3.kms_key string ALL +resources.jobs.*.tasks[*].for_each_task.task.new_cluster.init_scripts[*].s3.region string ALL +resources.jobs.*.tasks[*].for_each_task.task.new_cluster.init_scripts[*].volumes *compute.VolumesStorageInfo ALL +resources.jobs.*.tasks[*].for_each_task.task.new_cluster.init_scripts[*].volumes.destination string ALL +resources.jobs.*.tasks[*].for_each_task.task.new_cluster.init_scripts[*].workspace *compute.WorkspaceStorageInfo ALL +resources.jobs.*.tasks[*].for_each_task.task.new_cluster.init_scripts[*].workspace.destination string ALL +resources.jobs.*.tasks[*].for_each_task.task.new_cluster.instance_pool_id string ALL +resources.jobs.*.tasks[*].for_each_task.task.new_cluster.is_single_node bool ALL +resources.jobs.*.tasks[*].for_each_task.task.new_cluster.kind compute.Kind ALL +resources.jobs.*.tasks[*].for_each_task.task.new_cluster.node_type_id string ALL +resources.jobs.*.tasks[*].for_each_task.task.new_cluster.num_workers int ALL +resources.jobs.*.tasks[*].for_each_task.task.new_cluster.policy_id string ALL +resources.jobs.*.tasks[*].for_each_task.task.new_cluster.remote_disk_throughput int ALL +resources.jobs.*.tasks[*].for_each_task.task.new_cluster.runtime_engine compute.RuntimeEngine ALL +resources.jobs.*.tasks[*].for_each_task.task.new_cluster.single_user_name string ALL +resources.jobs.*.tasks[*].for_each_task.task.new_cluster.spark_conf map[string]string ALL +resources.jobs.*.tasks[*].for_each_task.task.new_cluster.spark_conf.* string ALL +resources.jobs.*.tasks[*].for_each_task.task.new_cluster.spark_env_vars map[string]string ALL +resources.jobs.*.tasks[*].for_each_task.task.new_cluster.spark_env_vars.* string ALL +resources.jobs.*.tasks[*].for_each_task.task.new_cluster.spark_version string ALL +resources.jobs.*.tasks[*].for_each_task.task.new_cluster.ssh_public_keys []string ALL +resources.jobs.*.tasks[*].for_each_task.task.new_cluster.ssh_public_keys[*] string ALL +resources.jobs.*.tasks[*].for_each_task.task.new_cluster.total_initial_remote_disk_size int ALL +resources.jobs.*.tasks[*].for_each_task.task.new_cluster.use_ml_runtime bool ALL +resources.jobs.*.tasks[*].for_each_task.task.new_cluster.worker_node_type_flexibility *compute.NodeTypeFlexibility ALL +resources.jobs.*.tasks[*].for_each_task.task.new_cluster.worker_node_type_flexibility.alternate_node_type_ids []string ALL +resources.jobs.*.tasks[*].for_each_task.task.new_cluster.worker_node_type_flexibility.alternate_node_type_ids[*] string ALL +resources.jobs.*.tasks[*].for_each_task.task.new_cluster.workload_type *compute.WorkloadType ALL +resources.jobs.*.tasks[*].for_each_task.task.new_cluster.workload_type.clients compute.ClientsTypes ALL +resources.jobs.*.tasks[*].for_each_task.task.new_cluster.workload_type.clients.jobs bool ALL +resources.jobs.*.tasks[*].for_each_task.task.new_cluster.workload_type.clients.notebooks bool ALL +resources.jobs.*.tasks[*].for_each_task.task.notebook_task *jobs.NotebookTask ALL +resources.jobs.*.tasks[*].for_each_task.task.notebook_task.base_parameters map[string]string ALL +resources.jobs.*.tasks[*].for_each_task.task.notebook_task.base_parameters.* string ALL +resources.jobs.*.tasks[*].for_each_task.task.notebook_task.notebook_path string ALL +resources.jobs.*.tasks[*].for_each_task.task.notebook_task.source jobs.Source ALL +resources.jobs.*.tasks[*].for_each_task.task.notebook_task.warehouse_id string ALL +resources.jobs.*.tasks[*].for_each_task.task.notification_settings *jobs.TaskNotificationSettings ALL +resources.jobs.*.tasks[*].for_each_task.task.notification_settings.alert_on_last_attempt bool ALL +resources.jobs.*.tasks[*].for_each_task.task.notification_settings.no_alert_for_canceled_runs bool ALL +resources.jobs.*.tasks[*].for_each_task.task.notification_settings.no_alert_for_skipped_runs bool ALL +resources.jobs.*.tasks[*].for_each_task.task.pipeline_task *jobs.PipelineTask ALL +resources.jobs.*.tasks[*].for_each_task.task.pipeline_task.full_refresh bool ALL +resources.jobs.*.tasks[*].for_each_task.task.pipeline_task.full_refresh_selection []string ALL +resources.jobs.*.tasks[*].for_each_task.task.pipeline_task.full_refresh_selection[*] string ALL +resources.jobs.*.tasks[*].for_each_task.task.pipeline_task.pipeline_id string ALL +resources.jobs.*.tasks[*].for_each_task.task.pipeline_task.refresh_flow_selection []string ALL +resources.jobs.*.tasks[*].for_each_task.task.pipeline_task.refresh_flow_selection[*] string ALL +resources.jobs.*.tasks[*].for_each_task.task.pipeline_task.refresh_selection []string ALL +resources.jobs.*.tasks[*].for_each_task.task.pipeline_task.refresh_selection[*] string ALL +resources.jobs.*.tasks[*].for_each_task.task.pipeline_task.reset_checkpoint_selection []string ALL +resources.jobs.*.tasks[*].for_each_task.task.pipeline_task.reset_checkpoint_selection[*] string ALL +resources.jobs.*.tasks[*].for_each_task.task.power_bi_task *jobs.PowerBiTask ALL +resources.jobs.*.tasks[*].for_each_task.task.power_bi_task.connection_resource_name string ALL +resources.jobs.*.tasks[*].for_each_task.task.power_bi_task.power_bi_model *jobs.PowerBiModel ALL +resources.jobs.*.tasks[*].for_each_task.task.power_bi_task.power_bi_model.authentication_method jobs.AuthenticationMethod ALL +resources.jobs.*.tasks[*].for_each_task.task.power_bi_task.power_bi_model.model_name string ALL +resources.jobs.*.tasks[*].for_each_task.task.power_bi_task.power_bi_model.overwrite_existing bool ALL +resources.jobs.*.tasks[*].for_each_task.task.power_bi_task.power_bi_model.storage_mode jobs.StorageMode ALL +resources.jobs.*.tasks[*].for_each_task.task.power_bi_task.power_bi_model.workspace_name string ALL +resources.jobs.*.tasks[*].for_each_task.task.power_bi_task.refresh_after_update bool ALL +resources.jobs.*.tasks[*].for_each_task.task.power_bi_task.tables []jobs.PowerBiTable ALL +resources.jobs.*.tasks[*].for_each_task.task.power_bi_task.tables[*] jobs.PowerBiTable ALL +resources.jobs.*.tasks[*].for_each_task.task.power_bi_task.tables[*].catalog string ALL +resources.jobs.*.tasks[*].for_each_task.task.power_bi_task.tables[*].name string ALL +resources.jobs.*.tasks[*].for_each_task.task.power_bi_task.tables[*].schema string ALL +resources.jobs.*.tasks[*].for_each_task.task.power_bi_task.tables[*].storage_mode jobs.StorageMode ALL +resources.jobs.*.tasks[*].for_each_task.task.power_bi_task.warehouse_id string ALL +resources.jobs.*.tasks[*].for_each_task.task.python_operator_task *jobs.PythonOperatorTask ALL +resources.jobs.*.tasks[*].for_each_task.task.python_operator_task.main string ALL +resources.jobs.*.tasks[*].for_each_task.task.python_operator_task.parameters []jobs.PythonOperatorTaskParameter ALL +resources.jobs.*.tasks[*].for_each_task.task.python_operator_task.parameters[*] jobs.PythonOperatorTaskParameter ALL +resources.jobs.*.tasks[*].for_each_task.task.python_operator_task.parameters[*].name string ALL +resources.jobs.*.tasks[*].for_each_task.task.python_operator_task.parameters[*].value string ALL +resources.jobs.*.tasks[*].for_each_task.task.python_wheel_task *jobs.PythonWheelTask ALL +resources.jobs.*.tasks[*].for_each_task.task.python_wheel_task.entry_point string ALL +resources.jobs.*.tasks[*].for_each_task.task.python_wheel_task.named_parameters map[string]string ALL +resources.jobs.*.tasks[*].for_each_task.task.python_wheel_task.named_parameters.* string ALL +resources.jobs.*.tasks[*].for_each_task.task.python_wheel_task.package_name string ALL +resources.jobs.*.tasks[*].for_each_task.task.python_wheel_task.parameters []string ALL +resources.jobs.*.tasks[*].for_each_task.task.python_wheel_task.parameters[*] string ALL +resources.jobs.*.tasks[*].for_each_task.task.retry_on_timeout bool ALL +resources.jobs.*.tasks[*].for_each_task.task.run_if jobs.RunIf ALL +resources.jobs.*.tasks[*].for_each_task.task.run_job_task *jobs.RunJobTask ALL +resources.jobs.*.tasks[*].for_each_task.task.run_job_task.dbt_commands []string ALL +resources.jobs.*.tasks[*].for_each_task.task.run_job_task.dbt_commands[*] string ALL +resources.jobs.*.tasks[*].for_each_task.task.run_job_task.jar_params []string ALL +resources.jobs.*.tasks[*].for_each_task.task.run_job_task.jar_params[*] string ALL +resources.jobs.*.tasks[*].for_each_task.task.run_job_task.job_id int64 ALL +resources.jobs.*.tasks[*].for_each_task.task.run_job_task.job_parameters map[string]string ALL +resources.jobs.*.tasks[*].for_each_task.task.run_job_task.job_parameters.* string ALL +resources.jobs.*.tasks[*].for_each_task.task.run_job_task.notebook_params map[string]string ALL +resources.jobs.*.tasks[*].for_each_task.task.run_job_task.notebook_params.* string ALL +resources.jobs.*.tasks[*].for_each_task.task.run_job_task.pipeline_params *jobs.PipelineParams ALL +resources.jobs.*.tasks[*].for_each_task.task.run_job_task.pipeline_params.full_refresh bool ALL +resources.jobs.*.tasks[*].for_each_task.task.run_job_task.pipeline_params.full_refresh_selection []string ALL +resources.jobs.*.tasks[*].for_each_task.task.run_job_task.pipeline_params.full_refresh_selection[*] string ALL +resources.jobs.*.tasks[*].for_each_task.task.run_job_task.pipeline_params.refresh_flow_selection []string ALL +resources.jobs.*.tasks[*].for_each_task.task.run_job_task.pipeline_params.refresh_flow_selection[*] string ALL +resources.jobs.*.tasks[*].for_each_task.task.run_job_task.pipeline_params.refresh_selection []string ALL +resources.jobs.*.tasks[*].for_each_task.task.run_job_task.pipeline_params.refresh_selection[*] string ALL +resources.jobs.*.tasks[*].for_each_task.task.run_job_task.pipeline_params.reset_checkpoint_selection []string ALL +resources.jobs.*.tasks[*].for_each_task.task.run_job_task.pipeline_params.reset_checkpoint_selection[*] string ALL +resources.jobs.*.tasks[*].for_each_task.task.run_job_task.python_named_params map[string]string ALL +resources.jobs.*.tasks[*].for_each_task.task.run_job_task.python_named_params.* string ALL +resources.jobs.*.tasks[*].for_each_task.task.run_job_task.python_params []string ALL +resources.jobs.*.tasks[*].for_each_task.task.run_job_task.python_params[*] string ALL +resources.jobs.*.tasks[*].for_each_task.task.run_job_task.spark_submit_params []string ALL +resources.jobs.*.tasks[*].for_each_task.task.run_job_task.spark_submit_params[*] string ALL +resources.jobs.*.tasks[*].for_each_task.task.run_job_task.sql_params map[string]string ALL +resources.jobs.*.tasks[*].for_each_task.task.run_job_task.sql_params.* string ALL +resources.jobs.*.tasks[*].for_each_task.task.spark_jar_task *jobs.SparkJarTask ALL +resources.jobs.*.tasks[*].for_each_task.task.spark_jar_task.jar_uri string ALL +resources.jobs.*.tasks[*].for_each_task.task.spark_jar_task.main_class_name string ALL +resources.jobs.*.tasks[*].for_each_task.task.spark_jar_task.parameters []string ALL +resources.jobs.*.tasks[*].for_each_task.task.spark_jar_task.parameters[*] string ALL +resources.jobs.*.tasks[*].for_each_task.task.spark_jar_task.run_as_repl bool ALL +resources.jobs.*.tasks[*].for_each_task.task.spark_python_task *jobs.SparkPythonTask ALL +resources.jobs.*.tasks[*].for_each_task.task.spark_python_task.parameters []string ALL +resources.jobs.*.tasks[*].for_each_task.task.spark_python_task.parameters[*] string ALL +resources.jobs.*.tasks[*].for_each_task.task.spark_python_task.python_file string ALL +resources.jobs.*.tasks[*].for_each_task.task.spark_python_task.source jobs.Source ALL +resources.jobs.*.tasks[*].for_each_task.task.spark_submit_task *jobs.SparkSubmitTask ALL +resources.jobs.*.tasks[*].for_each_task.task.spark_submit_task.parameters []string ALL +resources.jobs.*.tasks[*].for_each_task.task.spark_submit_task.parameters[*] string ALL +resources.jobs.*.tasks[*].for_each_task.task.sql_task *jobs.SqlTask ALL +resources.jobs.*.tasks[*].for_each_task.task.sql_task.alert *jobs.SqlTaskAlert ALL +resources.jobs.*.tasks[*].for_each_task.task.sql_task.alert.alert_id string ALL +resources.jobs.*.tasks[*].for_each_task.task.sql_task.alert.pause_subscriptions bool ALL +resources.jobs.*.tasks[*].for_each_task.task.sql_task.alert.subscriptions []jobs.SqlTaskSubscription ALL +resources.jobs.*.tasks[*].for_each_task.task.sql_task.alert.subscriptions[*] jobs.SqlTaskSubscription ALL +resources.jobs.*.tasks[*].for_each_task.task.sql_task.alert.subscriptions[*].destination_id string ALL +resources.jobs.*.tasks[*].for_each_task.task.sql_task.alert.subscriptions[*].user_name string ALL +resources.jobs.*.tasks[*].for_each_task.task.sql_task.dashboard *jobs.SqlTaskDashboard ALL +resources.jobs.*.tasks[*].for_each_task.task.sql_task.dashboard.custom_subject string ALL +resources.jobs.*.tasks[*].for_each_task.task.sql_task.dashboard.dashboard_id string ALL +resources.jobs.*.tasks[*].for_each_task.task.sql_task.dashboard.pause_subscriptions bool ALL +resources.jobs.*.tasks[*].for_each_task.task.sql_task.dashboard.subscriptions []jobs.SqlTaskSubscription ALL +resources.jobs.*.tasks[*].for_each_task.task.sql_task.dashboard.subscriptions[*] jobs.SqlTaskSubscription ALL +resources.jobs.*.tasks[*].for_each_task.task.sql_task.dashboard.subscriptions[*].destination_id string ALL +resources.jobs.*.tasks[*].for_each_task.task.sql_task.dashboard.subscriptions[*].user_name string ALL +resources.jobs.*.tasks[*].for_each_task.task.sql_task.file *jobs.SqlTaskFile ALL +resources.jobs.*.tasks[*].for_each_task.task.sql_task.file.path string ALL +resources.jobs.*.tasks[*].for_each_task.task.sql_task.file.source jobs.Source ALL +resources.jobs.*.tasks[*].for_each_task.task.sql_task.parameters map[string]string ALL +resources.jobs.*.tasks[*].for_each_task.task.sql_task.parameters.* string ALL +resources.jobs.*.tasks[*].for_each_task.task.sql_task.query *jobs.SqlTaskQuery ALL +resources.jobs.*.tasks[*].for_each_task.task.sql_task.query.query_id string ALL +resources.jobs.*.tasks[*].for_each_task.task.sql_task.warehouse_id string ALL +resources.jobs.*.tasks[*].for_each_task.task.task_key string ALL +resources.jobs.*.tasks[*].for_each_task.task.timeout_seconds int ALL +resources.jobs.*.tasks[*].for_each_task.task.webhook_notifications *jobs.WebhookNotifications ALL +resources.jobs.*.tasks[*].for_each_task.task.webhook_notifications.on_duration_warning_threshold_exceeded []jobs.Webhook ALL +resources.jobs.*.tasks[*].for_each_task.task.webhook_notifications.on_duration_warning_threshold_exceeded[*] jobs.Webhook ALL +resources.jobs.*.tasks[*].for_each_task.task.webhook_notifications.on_duration_warning_threshold_exceeded[*].id string ALL +resources.jobs.*.tasks[*].for_each_task.task.webhook_notifications.on_failure []jobs.Webhook ALL +resources.jobs.*.tasks[*].for_each_task.task.webhook_notifications.on_failure[*] jobs.Webhook ALL +resources.jobs.*.tasks[*].for_each_task.task.webhook_notifications.on_failure[*].id string ALL +resources.jobs.*.tasks[*].for_each_task.task.webhook_notifications.on_start []jobs.Webhook ALL +resources.jobs.*.tasks[*].for_each_task.task.webhook_notifications.on_start[*] jobs.Webhook ALL +resources.jobs.*.tasks[*].for_each_task.task.webhook_notifications.on_start[*].id string ALL +resources.jobs.*.tasks[*].for_each_task.task.webhook_notifications.on_streaming_backlog_exceeded []jobs.Webhook ALL +resources.jobs.*.tasks[*].for_each_task.task.webhook_notifications.on_streaming_backlog_exceeded[*] jobs.Webhook ALL +resources.jobs.*.tasks[*].for_each_task.task.webhook_notifications.on_streaming_backlog_exceeded[*].id string ALL +resources.jobs.*.tasks[*].for_each_task.task.webhook_notifications.on_success []jobs.Webhook ALL +resources.jobs.*.tasks[*].for_each_task.task.webhook_notifications.on_success[*] jobs.Webhook ALL +resources.jobs.*.tasks[*].for_each_task.task.webhook_notifications.on_success[*].id string ALL +resources.jobs.*.tasks[*].gen_ai_compute_task *jobs.GenAiComputeTask ALL +resources.jobs.*.tasks[*].gen_ai_compute_task.command string ALL +resources.jobs.*.tasks[*].gen_ai_compute_task.compute *jobs.ComputeConfig ALL +resources.jobs.*.tasks[*].gen_ai_compute_task.compute.gpu_node_pool_id string ALL +resources.jobs.*.tasks[*].gen_ai_compute_task.compute.gpu_type string ALL +resources.jobs.*.tasks[*].gen_ai_compute_task.compute.num_gpus int ALL +resources.jobs.*.tasks[*].gen_ai_compute_task.dl_runtime_image string ALL +resources.jobs.*.tasks[*].gen_ai_compute_task.mlflow_experiment_name string ALL +resources.jobs.*.tasks[*].gen_ai_compute_task.source jobs.Source ALL +resources.jobs.*.tasks[*].gen_ai_compute_task.training_script_path string ALL +resources.jobs.*.tasks[*].gen_ai_compute_task.yaml_parameters string ALL +resources.jobs.*.tasks[*].gen_ai_compute_task.yaml_parameters_file_path string ALL +resources.jobs.*.tasks[*].health *jobs.JobsHealthRules ALL +resources.jobs.*.tasks[*].health.rules []jobs.JobsHealthRule ALL +resources.jobs.*.tasks[*].health.rules[*] jobs.JobsHealthRule ALL +resources.jobs.*.tasks[*].health.rules[*].metric jobs.JobsHealthMetric ALL +resources.jobs.*.tasks[*].health.rules[*].op jobs.JobsHealthOperator ALL +resources.jobs.*.tasks[*].health.rules[*].value int64 ALL +resources.jobs.*.tasks[*].job_cluster_key string ALL +resources.jobs.*.tasks[*].libraries []compute.Library ALL +resources.jobs.*.tasks[*].libraries[*] compute.Library ALL +resources.jobs.*.tasks[*].libraries[*].cran *compute.RCranLibrary ALL +resources.jobs.*.tasks[*].libraries[*].cran.package string ALL +resources.jobs.*.tasks[*].libraries[*].cran.repo string ALL +resources.jobs.*.tasks[*].libraries[*].egg string ALL +resources.jobs.*.tasks[*].libraries[*].jar string ALL +resources.jobs.*.tasks[*].libraries[*].maven *compute.MavenLibrary ALL +resources.jobs.*.tasks[*].libraries[*].maven.coordinates string ALL +resources.jobs.*.tasks[*].libraries[*].maven.exclusions []string ALL +resources.jobs.*.tasks[*].libraries[*].maven.exclusions[*] string ALL +resources.jobs.*.tasks[*].libraries[*].maven.repo string ALL +resources.jobs.*.tasks[*].libraries[*].pypi *compute.PythonPyPiLibrary ALL +resources.jobs.*.tasks[*].libraries[*].pypi.package string ALL +resources.jobs.*.tasks[*].libraries[*].pypi.repo string ALL +resources.jobs.*.tasks[*].libraries[*].requirements string ALL +resources.jobs.*.tasks[*].libraries[*].whl string ALL +resources.jobs.*.tasks[*].max_retries int ALL +resources.jobs.*.tasks[*].min_retry_interval_millis int ALL +resources.jobs.*.tasks[*].new_cluster *compute.ClusterSpec ALL +resources.jobs.*.tasks[*].new_cluster.apply_policy_default_values bool ALL +resources.jobs.*.tasks[*].new_cluster.autoscale *compute.AutoScale ALL +resources.jobs.*.tasks[*].new_cluster.autoscale.max_workers int ALL +resources.jobs.*.tasks[*].new_cluster.autoscale.min_workers int ALL +resources.jobs.*.tasks[*].new_cluster.autotermination_minutes int ALL +resources.jobs.*.tasks[*].new_cluster.aws_attributes *compute.AwsAttributes ALL +resources.jobs.*.tasks[*].new_cluster.aws_attributes.availability compute.AwsAvailability ALL +resources.jobs.*.tasks[*].new_cluster.aws_attributes.ebs_volume_count int ALL +resources.jobs.*.tasks[*].new_cluster.aws_attributes.ebs_volume_iops int ALL +resources.jobs.*.tasks[*].new_cluster.aws_attributes.ebs_volume_size int ALL +resources.jobs.*.tasks[*].new_cluster.aws_attributes.ebs_volume_throughput int ALL +resources.jobs.*.tasks[*].new_cluster.aws_attributes.ebs_volume_type compute.EbsVolumeType ALL +resources.jobs.*.tasks[*].new_cluster.aws_attributes.first_on_demand int ALL +resources.jobs.*.tasks[*].new_cluster.aws_attributes.instance_profile_arn string ALL +resources.jobs.*.tasks[*].new_cluster.aws_attributes.spot_bid_price_percent int ALL +resources.jobs.*.tasks[*].new_cluster.aws_attributes.zone_id string ALL +resources.jobs.*.tasks[*].new_cluster.azure_attributes *compute.AzureAttributes ALL +resources.jobs.*.tasks[*].new_cluster.azure_attributes.availability compute.AzureAvailability ALL +resources.jobs.*.tasks[*].new_cluster.azure_attributes.first_on_demand int ALL +resources.jobs.*.tasks[*].new_cluster.azure_attributes.log_analytics_info *compute.LogAnalyticsInfo ALL +resources.jobs.*.tasks[*].new_cluster.azure_attributes.log_analytics_info.log_analytics_primary_key string ALL +resources.jobs.*.tasks[*].new_cluster.azure_attributes.log_analytics_info.log_analytics_workspace_id string ALL +resources.jobs.*.tasks[*].new_cluster.azure_attributes.spot_bid_max_price float64 ALL +resources.jobs.*.tasks[*].new_cluster.cluster_log_conf *compute.ClusterLogConf ALL +resources.jobs.*.tasks[*].new_cluster.cluster_log_conf.dbfs *compute.DbfsStorageInfo ALL +resources.jobs.*.tasks[*].new_cluster.cluster_log_conf.dbfs.destination string ALL +resources.jobs.*.tasks[*].new_cluster.cluster_log_conf.s3 *compute.S3StorageInfo ALL +resources.jobs.*.tasks[*].new_cluster.cluster_log_conf.s3.canned_acl string ALL +resources.jobs.*.tasks[*].new_cluster.cluster_log_conf.s3.destination string ALL +resources.jobs.*.tasks[*].new_cluster.cluster_log_conf.s3.enable_encryption bool ALL +resources.jobs.*.tasks[*].new_cluster.cluster_log_conf.s3.encryption_type string ALL +resources.jobs.*.tasks[*].new_cluster.cluster_log_conf.s3.endpoint string ALL +resources.jobs.*.tasks[*].new_cluster.cluster_log_conf.s3.kms_key string ALL +resources.jobs.*.tasks[*].new_cluster.cluster_log_conf.s3.region string ALL +resources.jobs.*.tasks[*].new_cluster.cluster_log_conf.volumes *compute.VolumesStorageInfo ALL +resources.jobs.*.tasks[*].new_cluster.cluster_log_conf.volumes.destination string ALL +resources.jobs.*.tasks[*].new_cluster.cluster_name string ALL +resources.jobs.*.tasks[*].new_cluster.custom_tags map[string]string ALL +resources.jobs.*.tasks[*].new_cluster.custom_tags.* string ALL +resources.jobs.*.tasks[*].new_cluster.data_security_mode compute.DataSecurityMode ALL +resources.jobs.*.tasks[*].new_cluster.docker_image *compute.DockerImage ALL +resources.jobs.*.tasks[*].new_cluster.docker_image.basic_auth *compute.DockerBasicAuth ALL +resources.jobs.*.tasks[*].new_cluster.docker_image.basic_auth.password string ALL +resources.jobs.*.tasks[*].new_cluster.docker_image.basic_auth.username string ALL +resources.jobs.*.tasks[*].new_cluster.docker_image.url string ALL +resources.jobs.*.tasks[*].new_cluster.driver_instance_pool_id string ALL +resources.jobs.*.tasks[*].new_cluster.driver_node_type_flexibility *compute.NodeTypeFlexibility ALL +resources.jobs.*.tasks[*].new_cluster.driver_node_type_flexibility.alternate_node_type_ids []string ALL +resources.jobs.*.tasks[*].new_cluster.driver_node_type_flexibility.alternate_node_type_ids[*] string ALL +resources.jobs.*.tasks[*].new_cluster.driver_node_type_id string ALL +resources.jobs.*.tasks[*].new_cluster.enable_elastic_disk bool ALL +resources.jobs.*.tasks[*].new_cluster.enable_local_disk_encryption bool ALL +resources.jobs.*.tasks[*].new_cluster.gcp_attributes *compute.GcpAttributes ALL +resources.jobs.*.tasks[*].new_cluster.gcp_attributes.availability compute.GcpAvailability ALL +resources.jobs.*.tasks[*].new_cluster.gcp_attributes.boot_disk_size int ALL +resources.jobs.*.tasks[*].new_cluster.gcp_attributes.confidential_compute_type compute.ConfidentialComputeType ALL +resources.jobs.*.tasks[*].new_cluster.gcp_attributes.first_on_demand int ALL +resources.jobs.*.tasks[*].new_cluster.gcp_attributes.google_service_account string ALL +resources.jobs.*.tasks[*].new_cluster.gcp_attributes.local_ssd_count int ALL +resources.jobs.*.tasks[*].new_cluster.gcp_attributes.use_preemptible_executors bool ALL +resources.jobs.*.tasks[*].new_cluster.gcp_attributes.zone_id string ALL +resources.jobs.*.tasks[*].new_cluster.init_scripts []compute.InitScriptInfo ALL +resources.jobs.*.tasks[*].new_cluster.init_scripts[*] compute.InitScriptInfo ALL +resources.jobs.*.tasks[*].new_cluster.init_scripts[*].abfss *compute.Adlsgen2Info ALL +resources.jobs.*.tasks[*].new_cluster.init_scripts[*].abfss.destination string ALL +resources.jobs.*.tasks[*].new_cluster.init_scripts[*].dbfs *compute.DbfsStorageInfo ALL +resources.jobs.*.tasks[*].new_cluster.init_scripts[*].dbfs.destination string ALL +resources.jobs.*.tasks[*].new_cluster.init_scripts[*].file *compute.LocalFileInfo ALL +resources.jobs.*.tasks[*].new_cluster.init_scripts[*].file.destination string ALL +resources.jobs.*.tasks[*].new_cluster.init_scripts[*].gcs *compute.GcsStorageInfo ALL +resources.jobs.*.tasks[*].new_cluster.init_scripts[*].gcs.destination string ALL +resources.jobs.*.tasks[*].new_cluster.init_scripts[*].s3 *compute.S3StorageInfo ALL +resources.jobs.*.tasks[*].new_cluster.init_scripts[*].s3.canned_acl string ALL +resources.jobs.*.tasks[*].new_cluster.init_scripts[*].s3.destination string ALL +resources.jobs.*.tasks[*].new_cluster.init_scripts[*].s3.enable_encryption bool ALL +resources.jobs.*.tasks[*].new_cluster.init_scripts[*].s3.encryption_type string ALL +resources.jobs.*.tasks[*].new_cluster.init_scripts[*].s3.endpoint string ALL +resources.jobs.*.tasks[*].new_cluster.init_scripts[*].s3.kms_key string ALL +resources.jobs.*.tasks[*].new_cluster.init_scripts[*].s3.region string ALL +resources.jobs.*.tasks[*].new_cluster.init_scripts[*].volumes *compute.VolumesStorageInfo ALL +resources.jobs.*.tasks[*].new_cluster.init_scripts[*].volumes.destination string ALL +resources.jobs.*.tasks[*].new_cluster.init_scripts[*].workspace *compute.WorkspaceStorageInfo ALL +resources.jobs.*.tasks[*].new_cluster.init_scripts[*].workspace.destination string ALL +resources.jobs.*.tasks[*].new_cluster.instance_pool_id string ALL +resources.jobs.*.tasks[*].new_cluster.is_single_node bool ALL +resources.jobs.*.tasks[*].new_cluster.kind compute.Kind ALL +resources.jobs.*.tasks[*].new_cluster.node_type_id string ALL +resources.jobs.*.tasks[*].new_cluster.num_workers int ALL +resources.jobs.*.tasks[*].new_cluster.policy_id string ALL +resources.jobs.*.tasks[*].new_cluster.remote_disk_throughput int ALL +resources.jobs.*.tasks[*].new_cluster.runtime_engine compute.RuntimeEngine ALL +resources.jobs.*.tasks[*].new_cluster.single_user_name string ALL +resources.jobs.*.tasks[*].new_cluster.spark_conf map[string]string ALL +resources.jobs.*.tasks[*].new_cluster.spark_conf.* string ALL +resources.jobs.*.tasks[*].new_cluster.spark_env_vars map[string]string ALL +resources.jobs.*.tasks[*].new_cluster.spark_env_vars.* string ALL +resources.jobs.*.tasks[*].new_cluster.spark_version string ALL +resources.jobs.*.tasks[*].new_cluster.ssh_public_keys []string ALL +resources.jobs.*.tasks[*].new_cluster.ssh_public_keys[*] string ALL +resources.jobs.*.tasks[*].new_cluster.total_initial_remote_disk_size int ALL +resources.jobs.*.tasks[*].new_cluster.use_ml_runtime bool ALL +resources.jobs.*.tasks[*].new_cluster.worker_node_type_flexibility *compute.NodeTypeFlexibility ALL +resources.jobs.*.tasks[*].new_cluster.worker_node_type_flexibility.alternate_node_type_ids []string ALL +resources.jobs.*.tasks[*].new_cluster.worker_node_type_flexibility.alternate_node_type_ids[*] string ALL +resources.jobs.*.tasks[*].new_cluster.workload_type *compute.WorkloadType ALL +resources.jobs.*.tasks[*].new_cluster.workload_type.clients compute.ClientsTypes ALL +resources.jobs.*.tasks[*].new_cluster.workload_type.clients.jobs bool ALL +resources.jobs.*.tasks[*].new_cluster.workload_type.clients.notebooks bool ALL +resources.jobs.*.tasks[*].notebook_task *jobs.NotebookTask ALL +resources.jobs.*.tasks[*].notebook_task.base_parameters map[string]string ALL +resources.jobs.*.tasks[*].notebook_task.base_parameters.* string ALL +resources.jobs.*.tasks[*].notebook_task.notebook_path string ALL +resources.jobs.*.tasks[*].notebook_task.source jobs.Source ALL +resources.jobs.*.tasks[*].notebook_task.warehouse_id string ALL +resources.jobs.*.tasks[*].notification_settings *jobs.TaskNotificationSettings ALL +resources.jobs.*.tasks[*].notification_settings.alert_on_last_attempt bool ALL +resources.jobs.*.tasks[*].notification_settings.no_alert_for_canceled_runs bool ALL +resources.jobs.*.tasks[*].notification_settings.no_alert_for_skipped_runs bool ALL +resources.jobs.*.tasks[*].pipeline_task *jobs.PipelineTask ALL +resources.jobs.*.tasks[*].pipeline_task.full_refresh bool ALL +resources.jobs.*.tasks[*].pipeline_task.full_refresh_selection []string ALL +resources.jobs.*.tasks[*].pipeline_task.full_refresh_selection[*] string ALL +resources.jobs.*.tasks[*].pipeline_task.pipeline_id string ALL +resources.jobs.*.tasks[*].pipeline_task.refresh_flow_selection []string ALL +resources.jobs.*.tasks[*].pipeline_task.refresh_flow_selection[*] string ALL +resources.jobs.*.tasks[*].pipeline_task.refresh_selection []string ALL +resources.jobs.*.tasks[*].pipeline_task.refresh_selection[*] string ALL +resources.jobs.*.tasks[*].pipeline_task.reset_checkpoint_selection []string ALL +resources.jobs.*.tasks[*].pipeline_task.reset_checkpoint_selection[*] string ALL +resources.jobs.*.tasks[*].power_bi_task *jobs.PowerBiTask ALL +resources.jobs.*.tasks[*].power_bi_task.connection_resource_name string ALL +resources.jobs.*.tasks[*].power_bi_task.power_bi_model *jobs.PowerBiModel ALL +resources.jobs.*.tasks[*].power_bi_task.power_bi_model.authentication_method jobs.AuthenticationMethod ALL +resources.jobs.*.tasks[*].power_bi_task.power_bi_model.model_name string ALL +resources.jobs.*.tasks[*].power_bi_task.power_bi_model.overwrite_existing bool ALL +resources.jobs.*.tasks[*].power_bi_task.power_bi_model.storage_mode jobs.StorageMode ALL +resources.jobs.*.tasks[*].power_bi_task.power_bi_model.workspace_name string ALL +resources.jobs.*.tasks[*].power_bi_task.refresh_after_update bool ALL +resources.jobs.*.tasks[*].power_bi_task.tables []jobs.PowerBiTable ALL +resources.jobs.*.tasks[*].power_bi_task.tables[*] jobs.PowerBiTable ALL +resources.jobs.*.tasks[*].power_bi_task.tables[*].catalog string ALL +resources.jobs.*.tasks[*].power_bi_task.tables[*].name string ALL +resources.jobs.*.tasks[*].power_bi_task.tables[*].schema string ALL +resources.jobs.*.tasks[*].power_bi_task.tables[*].storage_mode jobs.StorageMode ALL +resources.jobs.*.tasks[*].power_bi_task.warehouse_id string ALL +resources.jobs.*.tasks[*].python_operator_task *jobs.PythonOperatorTask ALL +resources.jobs.*.tasks[*].python_operator_task.main string ALL +resources.jobs.*.tasks[*].python_operator_task.parameters []jobs.PythonOperatorTaskParameter ALL +resources.jobs.*.tasks[*].python_operator_task.parameters[*] jobs.PythonOperatorTaskParameter ALL +resources.jobs.*.tasks[*].python_operator_task.parameters[*].name string ALL +resources.jobs.*.tasks[*].python_operator_task.parameters[*].value string ALL +resources.jobs.*.tasks[*].python_wheel_task *jobs.PythonWheelTask ALL +resources.jobs.*.tasks[*].python_wheel_task.entry_point string ALL +resources.jobs.*.tasks[*].python_wheel_task.named_parameters map[string]string ALL +resources.jobs.*.tasks[*].python_wheel_task.named_parameters.* string ALL +resources.jobs.*.tasks[*].python_wheel_task.package_name string ALL +resources.jobs.*.tasks[*].python_wheel_task.parameters []string ALL +resources.jobs.*.tasks[*].python_wheel_task.parameters[*] string ALL +resources.jobs.*.tasks[*].retry_on_timeout bool ALL +resources.jobs.*.tasks[*].run_if jobs.RunIf ALL +resources.jobs.*.tasks[*].run_job_task *jobs.RunJobTask ALL +resources.jobs.*.tasks[*].run_job_task.dbt_commands []string ALL +resources.jobs.*.tasks[*].run_job_task.dbt_commands[*] string ALL +resources.jobs.*.tasks[*].run_job_task.jar_params []string ALL +resources.jobs.*.tasks[*].run_job_task.jar_params[*] string ALL +resources.jobs.*.tasks[*].run_job_task.job_id int64 ALL +resources.jobs.*.tasks[*].run_job_task.job_parameters map[string]string ALL +resources.jobs.*.tasks[*].run_job_task.job_parameters.* string ALL +resources.jobs.*.tasks[*].run_job_task.notebook_params map[string]string ALL +resources.jobs.*.tasks[*].run_job_task.notebook_params.* string ALL +resources.jobs.*.tasks[*].run_job_task.pipeline_params *jobs.PipelineParams ALL +resources.jobs.*.tasks[*].run_job_task.pipeline_params.full_refresh bool ALL +resources.jobs.*.tasks[*].run_job_task.pipeline_params.full_refresh_selection []string ALL +resources.jobs.*.tasks[*].run_job_task.pipeline_params.full_refresh_selection[*] string ALL +resources.jobs.*.tasks[*].run_job_task.pipeline_params.refresh_flow_selection []string ALL +resources.jobs.*.tasks[*].run_job_task.pipeline_params.refresh_flow_selection[*] string ALL +resources.jobs.*.tasks[*].run_job_task.pipeline_params.refresh_selection []string ALL +resources.jobs.*.tasks[*].run_job_task.pipeline_params.refresh_selection[*] string ALL +resources.jobs.*.tasks[*].run_job_task.pipeline_params.reset_checkpoint_selection []string ALL +resources.jobs.*.tasks[*].run_job_task.pipeline_params.reset_checkpoint_selection[*] string ALL +resources.jobs.*.tasks[*].run_job_task.python_named_params map[string]string ALL +resources.jobs.*.tasks[*].run_job_task.python_named_params.* string ALL +resources.jobs.*.tasks[*].run_job_task.python_params []string ALL +resources.jobs.*.tasks[*].run_job_task.python_params[*] string ALL +resources.jobs.*.tasks[*].run_job_task.spark_submit_params []string ALL +resources.jobs.*.tasks[*].run_job_task.spark_submit_params[*] string ALL +resources.jobs.*.tasks[*].run_job_task.sql_params map[string]string ALL +resources.jobs.*.tasks[*].run_job_task.sql_params.* string ALL +resources.jobs.*.tasks[*].spark_jar_task *jobs.SparkJarTask ALL +resources.jobs.*.tasks[*].spark_jar_task.jar_uri string ALL +resources.jobs.*.tasks[*].spark_jar_task.main_class_name string ALL +resources.jobs.*.tasks[*].spark_jar_task.parameters []string ALL +resources.jobs.*.tasks[*].spark_jar_task.parameters[*] string ALL +resources.jobs.*.tasks[*].spark_jar_task.run_as_repl bool ALL +resources.jobs.*.tasks[*].spark_python_task *jobs.SparkPythonTask ALL +resources.jobs.*.tasks[*].spark_python_task.parameters []string ALL +resources.jobs.*.tasks[*].spark_python_task.parameters[*] string ALL +resources.jobs.*.tasks[*].spark_python_task.python_file string ALL +resources.jobs.*.tasks[*].spark_python_task.source jobs.Source ALL +resources.jobs.*.tasks[*].spark_submit_task *jobs.SparkSubmitTask ALL +resources.jobs.*.tasks[*].spark_submit_task.parameters []string ALL +resources.jobs.*.tasks[*].spark_submit_task.parameters[*] string ALL +resources.jobs.*.tasks[*].sql_task *jobs.SqlTask ALL +resources.jobs.*.tasks[*].sql_task.alert *jobs.SqlTaskAlert ALL +resources.jobs.*.tasks[*].sql_task.alert.alert_id string ALL +resources.jobs.*.tasks[*].sql_task.alert.pause_subscriptions bool ALL +resources.jobs.*.tasks[*].sql_task.alert.subscriptions []jobs.SqlTaskSubscription ALL +resources.jobs.*.tasks[*].sql_task.alert.subscriptions[*] jobs.SqlTaskSubscription ALL +resources.jobs.*.tasks[*].sql_task.alert.subscriptions[*].destination_id string ALL +resources.jobs.*.tasks[*].sql_task.alert.subscriptions[*].user_name string ALL +resources.jobs.*.tasks[*].sql_task.dashboard *jobs.SqlTaskDashboard ALL +resources.jobs.*.tasks[*].sql_task.dashboard.custom_subject string ALL +resources.jobs.*.tasks[*].sql_task.dashboard.dashboard_id string ALL +resources.jobs.*.tasks[*].sql_task.dashboard.pause_subscriptions bool ALL +resources.jobs.*.tasks[*].sql_task.dashboard.subscriptions []jobs.SqlTaskSubscription ALL +resources.jobs.*.tasks[*].sql_task.dashboard.subscriptions[*] jobs.SqlTaskSubscription ALL +resources.jobs.*.tasks[*].sql_task.dashboard.subscriptions[*].destination_id string ALL +resources.jobs.*.tasks[*].sql_task.dashboard.subscriptions[*].user_name string ALL +resources.jobs.*.tasks[*].sql_task.file *jobs.SqlTaskFile ALL +resources.jobs.*.tasks[*].sql_task.file.path string ALL +resources.jobs.*.tasks[*].sql_task.file.source jobs.Source ALL +resources.jobs.*.tasks[*].sql_task.parameters map[string]string ALL +resources.jobs.*.tasks[*].sql_task.parameters.* string ALL +resources.jobs.*.tasks[*].sql_task.query *jobs.SqlTaskQuery ALL +resources.jobs.*.tasks[*].sql_task.query.query_id string ALL +resources.jobs.*.tasks[*].sql_task.warehouse_id string ALL +resources.jobs.*.tasks[*].task_key string ALL +resources.jobs.*.tasks[*].timeout_seconds int ALL +resources.jobs.*.tasks[*].webhook_notifications *jobs.WebhookNotifications ALL +resources.jobs.*.tasks[*].webhook_notifications.on_duration_warning_threshold_exceeded []jobs.Webhook ALL +resources.jobs.*.tasks[*].webhook_notifications.on_duration_warning_threshold_exceeded[*] jobs.Webhook ALL +resources.jobs.*.tasks[*].webhook_notifications.on_duration_warning_threshold_exceeded[*].id string ALL +resources.jobs.*.tasks[*].webhook_notifications.on_failure []jobs.Webhook ALL +resources.jobs.*.tasks[*].webhook_notifications.on_failure[*] jobs.Webhook ALL +resources.jobs.*.tasks[*].webhook_notifications.on_failure[*].id string ALL +resources.jobs.*.tasks[*].webhook_notifications.on_start []jobs.Webhook ALL +resources.jobs.*.tasks[*].webhook_notifications.on_start[*] jobs.Webhook ALL +resources.jobs.*.tasks[*].webhook_notifications.on_start[*].id string ALL +resources.jobs.*.tasks[*].webhook_notifications.on_streaming_backlog_exceeded []jobs.Webhook ALL +resources.jobs.*.tasks[*].webhook_notifications.on_streaming_backlog_exceeded[*] jobs.Webhook ALL +resources.jobs.*.tasks[*].webhook_notifications.on_streaming_backlog_exceeded[*].id string ALL +resources.jobs.*.tasks[*].webhook_notifications.on_success []jobs.Webhook ALL +resources.jobs.*.tasks[*].webhook_notifications.on_success[*] jobs.Webhook ALL +resources.jobs.*.tasks[*].webhook_notifications.on_success[*].id string ALL +resources.jobs.*.timeout_seconds int ALL +resources.jobs.*.trigger *jobs.TriggerSettings ALL +resources.jobs.*.trigger.file_arrival *jobs.FileArrivalTriggerConfiguration ALL +resources.jobs.*.trigger.file_arrival.min_time_between_triggers_seconds int ALL +resources.jobs.*.trigger.file_arrival.url string ALL +resources.jobs.*.trigger.file_arrival.wait_after_last_change_seconds int ALL +resources.jobs.*.trigger.model *jobs.ModelTriggerConfiguration ALL +resources.jobs.*.trigger.model.aliases []string ALL +resources.jobs.*.trigger.model.aliases[*] string ALL +resources.jobs.*.trigger.model.condition jobs.ModelTriggerConfigurationCondition ALL +resources.jobs.*.trigger.model.min_time_between_triggers_seconds int ALL +resources.jobs.*.trigger.model.securable_name string ALL +resources.jobs.*.trigger.model.wait_after_last_change_seconds int ALL +resources.jobs.*.trigger.pause_status jobs.PauseStatus ALL +resources.jobs.*.trigger.periodic *jobs.PeriodicTriggerConfiguration ALL +resources.jobs.*.trigger.periodic.interval int ALL +resources.jobs.*.trigger.periodic.unit jobs.PeriodicTriggerConfigurationTimeUnit ALL +resources.jobs.*.trigger.table_update *jobs.TableUpdateTriggerConfiguration ALL +resources.jobs.*.trigger.table_update.condition jobs.Condition ALL +resources.jobs.*.trigger.table_update.min_time_between_triggers_seconds int ALL +resources.jobs.*.trigger.table_update.table_names []string ALL +resources.jobs.*.trigger.table_update.table_names[*] string ALL +resources.jobs.*.trigger.table_update.wait_after_last_change_seconds int ALL +resources.jobs.*.trigger_state *jobs.TriggerStateProto REMOTE +resources.jobs.*.trigger_state.file_arrival *jobs.FileArrivalTriggerState REMOTE +resources.jobs.*.trigger_state.file_arrival.using_file_events bool REMOTE +resources.jobs.*.trigger_state.table *jobs.TableTriggerState REMOTE +resources.jobs.*.trigger_state.table.last_seen_table_states []jobs.TableState REMOTE +resources.jobs.*.trigger_state.table.last_seen_table_states[*] jobs.TableState REMOTE +resources.jobs.*.trigger_state.table.last_seen_table_states[*].has_seen_updates bool REMOTE +resources.jobs.*.trigger_state.table.last_seen_table_states[*].table_name string REMOTE +resources.jobs.*.trigger_state.table.using_scalable_monitoring bool REMOTE +resources.jobs.*.url string INPUT +resources.jobs.*.usage_policy_id string ALL +resources.jobs.*.webhook_notifications *jobs.WebhookNotifications ALL +resources.jobs.*.webhook_notifications.on_duration_warning_threshold_exceeded []jobs.Webhook ALL +resources.jobs.*.webhook_notifications.on_duration_warning_threshold_exceeded[*] jobs.Webhook ALL +resources.jobs.*.webhook_notifications.on_duration_warning_threshold_exceeded[*].id string ALL +resources.jobs.*.webhook_notifications.on_failure []jobs.Webhook ALL +resources.jobs.*.webhook_notifications.on_failure[*] jobs.Webhook ALL +resources.jobs.*.webhook_notifications.on_failure[*].id string ALL +resources.jobs.*.webhook_notifications.on_start []jobs.Webhook ALL +resources.jobs.*.webhook_notifications.on_start[*] jobs.Webhook ALL +resources.jobs.*.webhook_notifications.on_start[*].id string ALL +resources.jobs.*.webhook_notifications.on_streaming_backlog_exceeded []jobs.Webhook ALL +resources.jobs.*.webhook_notifications.on_streaming_backlog_exceeded[*] jobs.Webhook ALL +resources.jobs.*.webhook_notifications.on_streaming_backlog_exceeded[*].id string ALL +resources.jobs.*.webhook_notifications.on_success []jobs.Webhook ALL +resources.jobs.*.webhook_notifications.on_success[*] jobs.Webhook ALL +resources.jobs.*.webhook_notifications.on_success[*].id string ALL +resources.jobs.*.permissions.object_id string ALL +resources.jobs.*.permissions[*] dresources.StatePermission ALL +resources.jobs.*.permissions[*].group_name string ALL +resources.jobs.*.permissions[*].level iam.PermissionLevel ALL +resources.jobs.*.permissions[*].service_principal_name string ALL +resources.jobs.*.permissions[*].user_name string ALL +resources.model_serving_endpoints.*.ai_gateway *serving.AiGatewayConfig INPUT STATE +resources.model_serving_endpoints.*.ai_gateway.fallback_config *serving.FallbackConfig INPUT STATE +resources.model_serving_endpoints.*.ai_gateway.fallback_config.enabled bool INPUT STATE +resources.model_serving_endpoints.*.ai_gateway.guardrails *serving.AiGatewayGuardrails INPUT STATE +resources.model_serving_endpoints.*.ai_gateway.guardrails.input *serving.AiGatewayGuardrailParameters INPUT STATE +resources.model_serving_endpoints.*.ai_gateway.guardrails.input.invalid_keywords []string INPUT STATE +resources.model_serving_endpoints.*.ai_gateway.guardrails.input.invalid_keywords[*] string INPUT STATE +resources.model_serving_endpoints.*.ai_gateway.guardrails.input.pii *serving.AiGatewayGuardrailPiiBehavior INPUT STATE +resources.model_serving_endpoints.*.ai_gateway.guardrails.input.pii.behavior serving.AiGatewayGuardrailPiiBehaviorBehavior INPUT STATE +resources.model_serving_endpoints.*.ai_gateway.guardrails.input.safety bool INPUT STATE +resources.model_serving_endpoints.*.ai_gateway.guardrails.input.valid_topics []string INPUT STATE +resources.model_serving_endpoints.*.ai_gateway.guardrails.input.valid_topics[*] string INPUT STATE +resources.model_serving_endpoints.*.ai_gateway.guardrails.output *serving.AiGatewayGuardrailParameters INPUT STATE +resources.model_serving_endpoints.*.ai_gateway.guardrails.output.invalid_keywords []string INPUT STATE +resources.model_serving_endpoints.*.ai_gateway.guardrails.output.invalid_keywords[*] string INPUT STATE +resources.model_serving_endpoints.*.ai_gateway.guardrails.output.pii *serving.AiGatewayGuardrailPiiBehavior INPUT STATE +resources.model_serving_endpoints.*.ai_gateway.guardrails.output.pii.behavior serving.AiGatewayGuardrailPiiBehaviorBehavior INPUT STATE +resources.model_serving_endpoints.*.ai_gateway.guardrails.output.safety bool INPUT STATE +resources.model_serving_endpoints.*.ai_gateway.guardrails.output.valid_topics []string INPUT STATE +resources.model_serving_endpoints.*.ai_gateway.guardrails.output.valid_topics[*] string INPUT STATE +resources.model_serving_endpoints.*.ai_gateway.inference_table_config *serving.AiGatewayInferenceTableConfig INPUT STATE +resources.model_serving_endpoints.*.ai_gateway.inference_table_config.catalog_name string INPUT STATE +resources.model_serving_endpoints.*.ai_gateway.inference_table_config.enabled bool INPUT STATE +resources.model_serving_endpoints.*.ai_gateway.inference_table_config.schema_name string INPUT STATE +resources.model_serving_endpoints.*.ai_gateway.inference_table_config.table_name_prefix string INPUT STATE +resources.model_serving_endpoints.*.ai_gateway.rate_limits []serving.AiGatewayRateLimit INPUT STATE +resources.model_serving_endpoints.*.ai_gateway.rate_limits[*] serving.AiGatewayRateLimit INPUT STATE +resources.model_serving_endpoints.*.ai_gateway.rate_limits[*].calls int64 INPUT STATE +resources.model_serving_endpoints.*.ai_gateway.rate_limits[*].key serving.AiGatewayRateLimitKey INPUT STATE +resources.model_serving_endpoints.*.ai_gateway.rate_limits[*].principal string INPUT STATE +resources.model_serving_endpoints.*.ai_gateway.rate_limits[*].renewal_period serving.AiGatewayRateLimitRenewalPeriod INPUT STATE +resources.model_serving_endpoints.*.ai_gateway.rate_limits[*].tokens int64 INPUT STATE +resources.model_serving_endpoints.*.ai_gateway.usage_tracking_config *serving.AiGatewayUsageTrackingConfig INPUT STATE +resources.model_serving_endpoints.*.ai_gateway.usage_tracking_config.enabled bool INPUT STATE +resources.model_serving_endpoints.*.budget_policy_id string INPUT STATE +resources.model_serving_endpoints.*.config *serving.EndpointCoreConfigInput INPUT STATE +resources.model_serving_endpoints.*.config.auto_capture_config *serving.AutoCaptureConfigInput INPUT STATE +resources.model_serving_endpoints.*.config.auto_capture_config.catalog_name string INPUT STATE +resources.model_serving_endpoints.*.config.auto_capture_config.enabled bool INPUT STATE +resources.model_serving_endpoints.*.config.auto_capture_config.schema_name string INPUT STATE +resources.model_serving_endpoints.*.config.auto_capture_config.table_name_prefix string INPUT STATE +resources.model_serving_endpoints.*.config.served_entities []serving.ServedEntityInput INPUT STATE +resources.model_serving_endpoints.*.config.served_entities[*] serving.ServedEntityInput INPUT STATE +resources.model_serving_endpoints.*.config.served_entities[*].burst_scaling_enabled bool INPUT STATE +resources.model_serving_endpoints.*.config.served_entities[*].entity_name string INPUT STATE +resources.model_serving_endpoints.*.config.served_entities[*].entity_version string INPUT STATE +resources.model_serving_endpoints.*.config.served_entities[*].environment_vars map[string]string INPUT STATE +resources.model_serving_endpoints.*.config.served_entities[*].environment_vars.* string INPUT STATE +resources.model_serving_endpoints.*.config.served_entities[*].external_model *serving.ExternalModel INPUT STATE +resources.model_serving_endpoints.*.config.served_entities[*].external_model.ai21labs_config *serving.Ai21LabsConfig INPUT STATE +resources.model_serving_endpoints.*.config.served_entities[*].external_model.ai21labs_config.ai21labs_api_key string INPUT STATE +resources.model_serving_endpoints.*.config.served_entities[*].external_model.ai21labs_config.ai21labs_api_key_plaintext string INPUT STATE +resources.model_serving_endpoints.*.config.served_entities[*].external_model.amazon_bedrock_config *serving.AmazonBedrockConfig INPUT STATE +resources.model_serving_endpoints.*.config.served_entities[*].external_model.amazon_bedrock_config.aws_access_key_id string INPUT STATE +resources.model_serving_endpoints.*.config.served_entities[*].external_model.amazon_bedrock_config.aws_access_key_id_plaintext string INPUT STATE +resources.model_serving_endpoints.*.config.served_entities[*].external_model.amazon_bedrock_config.aws_region string INPUT STATE +resources.model_serving_endpoints.*.config.served_entities[*].external_model.amazon_bedrock_config.aws_secret_access_key string INPUT STATE +resources.model_serving_endpoints.*.config.served_entities[*].external_model.amazon_bedrock_config.aws_secret_access_key_plaintext string INPUT STATE +resources.model_serving_endpoints.*.config.served_entities[*].external_model.amazon_bedrock_config.bedrock_provider serving.AmazonBedrockConfigBedrockProvider INPUT STATE +resources.model_serving_endpoints.*.config.served_entities[*].external_model.amazon_bedrock_config.instance_profile_arn string INPUT STATE +resources.model_serving_endpoints.*.config.served_entities[*].external_model.anthropic_config *serving.AnthropicConfig INPUT STATE +resources.model_serving_endpoints.*.config.served_entities[*].external_model.anthropic_config.anthropic_api_key string INPUT STATE +resources.model_serving_endpoints.*.config.served_entities[*].external_model.anthropic_config.anthropic_api_key_plaintext string INPUT STATE +resources.model_serving_endpoints.*.config.served_entities[*].external_model.cohere_config *serving.CohereConfig INPUT STATE +resources.model_serving_endpoints.*.config.served_entities[*].external_model.cohere_config.cohere_api_base string INPUT STATE +resources.model_serving_endpoints.*.config.served_entities[*].external_model.cohere_config.cohere_api_key string INPUT STATE +resources.model_serving_endpoints.*.config.served_entities[*].external_model.cohere_config.cohere_api_key_plaintext string INPUT STATE +resources.model_serving_endpoints.*.config.served_entities[*].external_model.custom_provider_config *serving.CustomProviderConfig INPUT STATE +resources.model_serving_endpoints.*.config.served_entities[*].external_model.custom_provider_config.api_key_auth *serving.ApiKeyAuth INPUT STATE +resources.model_serving_endpoints.*.config.served_entities[*].external_model.custom_provider_config.api_key_auth.key string INPUT STATE +resources.model_serving_endpoints.*.config.served_entities[*].external_model.custom_provider_config.api_key_auth.value string INPUT STATE +resources.model_serving_endpoints.*.config.served_entities[*].external_model.custom_provider_config.api_key_auth.value_plaintext string INPUT STATE +resources.model_serving_endpoints.*.config.served_entities[*].external_model.custom_provider_config.bearer_token_auth *serving.BearerTokenAuth INPUT STATE +resources.model_serving_endpoints.*.config.served_entities[*].external_model.custom_provider_config.bearer_token_auth.token string INPUT STATE +resources.model_serving_endpoints.*.config.served_entities[*].external_model.custom_provider_config.bearer_token_auth.token_plaintext string INPUT STATE +resources.model_serving_endpoints.*.config.served_entities[*].external_model.custom_provider_config.custom_provider_url string INPUT STATE +resources.model_serving_endpoints.*.config.served_entities[*].external_model.databricks_model_serving_config *serving.DatabricksModelServingConfig INPUT STATE +resources.model_serving_endpoints.*.config.served_entities[*].external_model.databricks_model_serving_config.databricks_api_token string INPUT STATE +resources.model_serving_endpoints.*.config.served_entities[*].external_model.databricks_model_serving_config.databricks_api_token_plaintext string INPUT STATE +resources.model_serving_endpoints.*.config.served_entities[*].external_model.databricks_model_serving_config.databricks_workspace_url string INPUT STATE +resources.model_serving_endpoints.*.config.served_entities[*].external_model.google_cloud_vertex_ai_config *serving.GoogleCloudVertexAiConfig INPUT STATE +resources.model_serving_endpoints.*.config.served_entities[*].external_model.google_cloud_vertex_ai_config.private_key string INPUT STATE +resources.model_serving_endpoints.*.config.served_entities[*].external_model.google_cloud_vertex_ai_config.private_key_plaintext string INPUT STATE +resources.model_serving_endpoints.*.config.served_entities[*].external_model.google_cloud_vertex_ai_config.project_id string INPUT STATE +resources.model_serving_endpoints.*.config.served_entities[*].external_model.google_cloud_vertex_ai_config.region string INPUT STATE +resources.model_serving_endpoints.*.config.served_entities[*].external_model.name string INPUT STATE +resources.model_serving_endpoints.*.config.served_entities[*].external_model.openai_config *serving.OpenAiConfig INPUT STATE +resources.model_serving_endpoints.*.config.served_entities[*].external_model.openai_config.microsoft_entra_client_id string INPUT STATE +resources.model_serving_endpoints.*.config.served_entities[*].external_model.openai_config.microsoft_entra_client_secret string INPUT STATE +resources.model_serving_endpoints.*.config.served_entities[*].external_model.openai_config.microsoft_entra_client_secret_plaintext string INPUT STATE +resources.model_serving_endpoints.*.config.served_entities[*].external_model.openai_config.microsoft_entra_tenant_id string INPUT STATE +resources.model_serving_endpoints.*.config.served_entities[*].external_model.openai_config.openai_api_base string INPUT STATE +resources.model_serving_endpoints.*.config.served_entities[*].external_model.openai_config.openai_api_key string INPUT STATE +resources.model_serving_endpoints.*.config.served_entities[*].external_model.openai_config.openai_api_key_plaintext string INPUT STATE +resources.model_serving_endpoints.*.config.served_entities[*].external_model.openai_config.openai_api_type string INPUT STATE +resources.model_serving_endpoints.*.config.served_entities[*].external_model.openai_config.openai_api_version string INPUT STATE +resources.model_serving_endpoints.*.config.served_entities[*].external_model.openai_config.openai_deployment_name string INPUT STATE +resources.model_serving_endpoints.*.config.served_entities[*].external_model.openai_config.openai_organization string INPUT STATE +resources.model_serving_endpoints.*.config.served_entities[*].external_model.palm_config *serving.PaLmConfig INPUT STATE +resources.model_serving_endpoints.*.config.served_entities[*].external_model.palm_config.palm_api_key string INPUT STATE +resources.model_serving_endpoints.*.config.served_entities[*].external_model.palm_config.palm_api_key_plaintext string INPUT STATE +resources.model_serving_endpoints.*.config.served_entities[*].external_model.provider serving.ExternalModelProvider INPUT STATE +resources.model_serving_endpoints.*.config.served_entities[*].external_model.task string INPUT STATE +resources.model_serving_endpoints.*.config.served_entities[*].instance_profile_arn string INPUT STATE +resources.model_serving_endpoints.*.config.served_entities[*].max_provisioned_concurrency int INPUT STATE +resources.model_serving_endpoints.*.config.served_entities[*].max_provisioned_throughput int INPUT STATE +resources.model_serving_endpoints.*.config.served_entities[*].min_provisioned_concurrency int INPUT STATE +resources.model_serving_endpoints.*.config.served_entities[*].min_provisioned_throughput int INPUT STATE +resources.model_serving_endpoints.*.config.served_entities[*].name string INPUT STATE +resources.model_serving_endpoints.*.config.served_entities[*].provisioned_model_units int64 INPUT STATE +resources.model_serving_endpoints.*.config.served_entities[*].scale_to_zero_enabled bool INPUT STATE +resources.model_serving_endpoints.*.config.served_entities[*].workload_size string INPUT STATE +resources.model_serving_endpoints.*.config.served_entities[*].workload_type serving.ServingModelWorkloadType INPUT STATE +resources.model_serving_endpoints.*.config.served_models []serving.ServedModelInput INPUT STATE +resources.model_serving_endpoints.*.config.served_models[*] serving.ServedModelInput INPUT STATE +resources.model_serving_endpoints.*.config.served_models[*].burst_scaling_enabled bool INPUT STATE +resources.model_serving_endpoints.*.config.served_models[*].environment_vars map[string]string INPUT STATE +resources.model_serving_endpoints.*.config.served_models[*].environment_vars.* string INPUT STATE +resources.model_serving_endpoints.*.config.served_models[*].instance_profile_arn string INPUT STATE +resources.model_serving_endpoints.*.config.served_models[*].max_provisioned_concurrency int INPUT STATE +resources.model_serving_endpoints.*.config.served_models[*].max_provisioned_throughput int INPUT STATE +resources.model_serving_endpoints.*.config.served_models[*].min_provisioned_concurrency int INPUT STATE +resources.model_serving_endpoints.*.config.served_models[*].min_provisioned_throughput int INPUT STATE +resources.model_serving_endpoints.*.config.served_models[*].model_name string INPUT STATE +resources.model_serving_endpoints.*.config.served_models[*].model_version string INPUT STATE +resources.model_serving_endpoints.*.config.served_models[*].name string INPUT STATE +resources.model_serving_endpoints.*.config.served_models[*].provisioned_model_units int64 INPUT STATE +resources.model_serving_endpoints.*.config.served_models[*].scale_to_zero_enabled bool INPUT STATE +resources.model_serving_endpoints.*.config.served_models[*].workload_size string INPUT STATE +resources.model_serving_endpoints.*.config.served_models[*].workload_type serving.ServedModelInputWorkloadType INPUT STATE +resources.model_serving_endpoints.*.config.traffic_config *serving.TrafficConfig INPUT STATE +resources.model_serving_endpoints.*.config.traffic_config.routes []serving.Route INPUT STATE +resources.model_serving_endpoints.*.config.traffic_config.routes[*] serving.Route INPUT STATE +resources.model_serving_endpoints.*.config.traffic_config.routes[*].served_entity_name string INPUT STATE +resources.model_serving_endpoints.*.config.traffic_config.routes[*].served_model_name string INPUT STATE +resources.model_serving_endpoints.*.config.traffic_config.routes[*].traffic_percentage int INPUT STATE +resources.model_serving_endpoints.*.description string INPUT STATE +resources.model_serving_endpoints.*.email_notifications *serving.EmailNotifications INPUT STATE +resources.model_serving_endpoints.*.email_notifications.on_update_failure []string INPUT STATE +resources.model_serving_endpoints.*.email_notifications.on_update_failure[*] string INPUT STATE +resources.model_serving_endpoints.*.email_notifications.on_update_success []string INPUT STATE +resources.model_serving_endpoints.*.email_notifications.on_update_success[*] string INPUT STATE +resources.model_serving_endpoints.*.endpoint_details *serving.ServingEndpointDetailed REMOTE +resources.model_serving_endpoints.*.endpoint_details.ai_gateway *serving.AiGatewayConfig REMOTE +resources.model_serving_endpoints.*.endpoint_details.ai_gateway.fallback_config *serving.FallbackConfig REMOTE +resources.model_serving_endpoints.*.endpoint_details.ai_gateway.fallback_config.enabled bool REMOTE +resources.model_serving_endpoints.*.endpoint_details.ai_gateway.guardrails *serving.AiGatewayGuardrails REMOTE +resources.model_serving_endpoints.*.endpoint_details.ai_gateway.guardrails.input *serving.AiGatewayGuardrailParameters REMOTE +resources.model_serving_endpoints.*.endpoint_details.ai_gateway.guardrails.input.invalid_keywords []string REMOTE +resources.model_serving_endpoints.*.endpoint_details.ai_gateway.guardrails.input.invalid_keywords[*] string REMOTE +resources.model_serving_endpoints.*.endpoint_details.ai_gateway.guardrails.input.pii *serving.AiGatewayGuardrailPiiBehavior REMOTE +resources.model_serving_endpoints.*.endpoint_details.ai_gateway.guardrails.input.pii.behavior serving.AiGatewayGuardrailPiiBehaviorBehavior REMOTE +resources.model_serving_endpoints.*.endpoint_details.ai_gateway.guardrails.input.safety bool REMOTE +resources.model_serving_endpoints.*.endpoint_details.ai_gateway.guardrails.input.valid_topics []string REMOTE +resources.model_serving_endpoints.*.endpoint_details.ai_gateway.guardrails.input.valid_topics[*] string REMOTE +resources.model_serving_endpoints.*.endpoint_details.ai_gateway.guardrails.output *serving.AiGatewayGuardrailParameters REMOTE +resources.model_serving_endpoints.*.endpoint_details.ai_gateway.guardrails.output.invalid_keywords []string REMOTE +resources.model_serving_endpoints.*.endpoint_details.ai_gateway.guardrails.output.invalid_keywords[*] string REMOTE +resources.model_serving_endpoints.*.endpoint_details.ai_gateway.guardrails.output.pii *serving.AiGatewayGuardrailPiiBehavior REMOTE +resources.model_serving_endpoints.*.endpoint_details.ai_gateway.guardrails.output.pii.behavior serving.AiGatewayGuardrailPiiBehaviorBehavior REMOTE +resources.model_serving_endpoints.*.endpoint_details.ai_gateway.guardrails.output.safety bool REMOTE +resources.model_serving_endpoints.*.endpoint_details.ai_gateway.guardrails.output.valid_topics []string REMOTE +resources.model_serving_endpoints.*.endpoint_details.ai_gateway.guardrails.output.valid_topics[*] string REMOTE +resources.model_serving_endpoints.*.endpoint_details.ai_gateway.inference_table_config *serving.AiGatewayInferenceTableConfig REMOTE +resources.model_serving_endpoints.*.endpoint_details.ai_gateway.inference_table_config.catalog_name string REMOTE +resources.model_serving_endpoints.*.endpoint_details.ai_gateway.inference_table_config.enabled bool REMOTE +resources.model_serving_endpoints.*.endpoint_details.ai_gateway.inference_table_config.schema_name string REMOTE +resources.model_serving_endpoints.*.endpoint_details.ai_gateway.inference_table_config.table_name_prefix string REMOTE +resources.model_serving_endpoints.*.endpoint_details.ai_gateway.rate_limits []serving.AiGatewayRateLimit REMOTE +resources.model_serving_endpoints.*.endpoint_details.ai_gateway.rate_limits[*] serving.AiGatewayRateLimit REMOTE +resources.model_serving_endpoints.*.endpoint_details.ai_gateway.rate_limits[*].calls int64 REMOTE +resources.model_serving_endpoints.*.endpoint_details.ai_gateway.rate_limits[*].key serving.AiGatewayRateLimitKey REMOTE +resources.model_serving_endpoints.*.endpoint_details.ai_gateway.rate_limits[*].principal string REMOTE +resources.model_serving_endpoints.*.endpoint_details.ai_gateway.rate_limits[*].renewal_period serving.AiGatewayRateLimitRenewalPeriod REMOTE +resources.model_serving_endpoints.*.endpoint_details.ai_gateway.rate_limits[*].tokens int64 REMOTE +resources.model_serving_endpoints.*.endpoint_details.ai_gateway.usage_tracking_config *serving.AiGatewayUsageTrackingConfig REMOTE +resources.model_serving_endpoints.*.endpoint_details.ai_gateway.usage_tracking_config.enabled bool REMOTE +resources.model_serving_endpoints.*.endpoint_details.budget_policy_id string REMOTE +resources.model_serving_endpoints.*.endpoint_details.config *serving.EndpointCoreConfigOutput REMOTE +resources.model_serving_endpoints.*.endpoint_details.config.auto_capture_config *serving.AutoCaptureConfigOutput REMOTE +resources.model_serving_endpoints.*.endpoint_details.config.auto_capture_config.catalog_name string REMOTE +resources.model_serving_endpoints.*.endpoint_details.config.auto_capture_config.enabled bool REMOTE +resources.model_serving_endpoints.*.endpoint_details.config.auto_capture_config.schema_name string REMOTE +resources.model_serving_endpoints.*.endpoint_details.config.auto_capture_config.state *serving.AutoCaptureState REMOTE +resources.model_serving_endpoints.*.endpoint_details.config.auto_capture_config.state.payload_table *serving.PayloadTable REMOTE +resources.model_serving_endpoints.*.endpoint_details.config.auto_capture_config.state.payload_table.name string REMOTE +resources.model_serving_endpoints.*.endpoint_details.config.auto_capture_config.state.payload_table.status string REMOTE +resources.model_serving_endpoints.*.endpoint_details.config.auto_capture_config.state.payload_table.status_message string REMOTE +resources.model_serving_endpoints.*.endpoint_details.config.auto_capture_config.table_name_prefix string REMOTE +resources.model_serving_endpoints.*.endpoint_details.config.config_version int64 REMOTE +resources.model_serving_endpoints.*.endpoint_details.config.served_entities []serving.ServedEntityOutput REMOTE +resources.model_serving_endpoints.*.endpoint_details.config.served_entities[*] serving.ServedEntityOutput REMOTE +resources.model_serving_endpoints.*.endpoint_details.config.served_entities[*].burst_scaling_enabled bool REMOTE +resources.model_serving_endpoints.*.endpoint_details.config.served_entities[*].creation_timestamp int64 REMOTE +resources.model_serving_endpoints.*.endpoint_details.config.served_entities[*].creator string REMOTE +resources.model_serving_endpoints.*.endpoint_details.config.served_entities[*].entity_name string REMOTE +resources.model_serving_endpoints.*.endpoint_details.config.served_entities[*].entity_version string REMOTE +resources.model_serving_endpoints.*.endpoint_details.config.served_entities[*].environment_vars map[string]string REMOTE +resources.model_serving_endpoints.*.endpoint_details.config.served_entities[*].environment_vars.* string REMOTE +resources.model_serving_endpoints.*.endpoint_details.config.served_entities[*].external_model *serving.ExternalModel REMOTE +resources.model_serving_endpoints.*.endpoint_details.config.served_entities[*].external_model.ai21labs_config *serving.Ai21LabsConfig REMOTE +resources.model_serving_endpoints.*.endpoint_details.config.served_entities[*].external_model.ai21labs_config.ai21labs_api_key string REMOTE +resources.model_serving_endpoints.*.endpoint_details.config.served_entities[*].external_model.ai21labs_config.ai21labs_api_key_plaintext string REMOTE +resources.model_serving_endpoints.*.endpoint_details.config.served_entities[*].external_model.amazon_bedrock_config *serving.AmazonBedrockConfig REMOTE +resources.model_serving_endpoints.*.endpoint_details.config.served_entities[*].external_model.amazon_bedrock_config.aws_access_key_id string REMOTE +resources.model_serving_endpoints.*.endpoint_details.config.served_entities[*].external_model.amazon_bedrock_config.aws_access_key_id_plaintext string REMOTE +resources.model_serving_endpoints.*.endpoint_details.config.served_entities[*].external_model.amazon_bedrock_config.aws_region string REMOTE +resources.model_serving_endpoints.*.endpoint_details.config.served_entities[*].external_model.amazon_bedrock_config.aws_secret_access_key string REMOTE +resources.model_serving_endpoints.*.endpoint_details.config.served_entities[*].external_model.amazon_bedrock_config.aws_secret_access_key_plaintext string REMOTE +resources.model_serving_endpoints.*.endpoint_details.config.served_entities[*].external_model.amazon_bedrock_config.bedrock_provider serving.AmazonBedrockConfigBedrockProvider REMOTE +resources.model_serving_endpoints.*.endpoint_details.config.served_entities[*].external_model.amazon_bedrock_config.instance_profile_arn string REMOTE +resources.model_serving_endpoints.*.endpoint_details.config.served_entities[*].external_model.anthropic_config *serving.AnthropicConfig REMOTE +resources.model_serving_endpoints.*.endpoint_details.config.served_entities[*].external_model.anthropic_config.anthropic_api_key string REMOTE +resources.model_serving_endpoints.*.endpoint_details.config.served_entities[*].external_model.anthropic_config.anthropic_api_key_plaintext string REMOTE +resources.model_serving_endpoints.*.endpoint_details.config.served_entities[*].external_model.cohere_config *serving.CohereConfig REMOTE +resources.model_serving_endpoints.*.endpoint_details.config.served_entities[*].external_model.cohere_config.cohere_api_base string REMOTE +resources.model_serving_endpoints.*.endpoint_details.config.served_entities[*].external_model.cohere_config.cohere_api_key string REMOTE +resources.model_serving_endpoints.*.endpoint_details.config.served_entities[*].external_model.cohere_config.cohere_api_key_plaintext string REMOTE +resources.model_serving_endpoints.*.endpoint_details.config.served_entities[*].external_model.custom_provider_config *serving.CustomProviderConfig REMOTE +resources.model_serving_endpoints.*.endpoint_details.config.served_entities[*].external_model.custom_provider_config.api_key_auth *serving.ApiKeyAuth REMOTE +resources.model_serving_endpoints.*.endpoint_details.config.served_entities[*].external_model.custom_provider_config.api_key_auth.key string REMOTE +resources.model_serving_endpoints.*.endpoint_details.config.served_entities[*].external_model.custom_provider_config.api_key_auth.value string REMOTE +resources.model_serving_endpoints.*.endpoint_details.config.served_entities[*].external_model.custom_provider_config.api_key_auth.value_plaintext string REMOTE +resources.model_serving_endpoints.*.endpoint_details.config.served_entities[*].external_model.custom_provider_config.bearer_token_auth *serving.BearerTokenAuth REMOTE +resources.model_serving_endpoints.*.endpoint_details.config.served_entities[*].external_model.custom_provider_config.bearer_token_auth.token string REMOTE +resources.model_serving_endpoints.*.endpoint_details.config.served_entities[*].external_model.custom_provider_config.bearer_token_auth.token_plaintext string REMOTE +resources.model_serving_endpoints.*.endpoint_details.config.served_entities[*].external_model.custom_provider_config.custom_provider_url string REMOTE +resources.model_serving_endpoints.*.endpoint_details.config.served_entities[*].external_model.databricks_model_serving_config *serving.DatabricksModelServingConfig REMOTE +resources.model_serving_endpoints.*.endpoint_details.config.served_entities[*].external_model.databricks_model_serving_config.databricks_api_token string REMOTE +resources.model_serving_endpoints.*.endpoint_details.config.served_entities[*].external_model.databricks_model_serving_config.databricks_api_token_plaintext string REMOTE +resources.model_serving_endpoints.*.endpoint_details.config.served_entities[*].external_model.databricks_model_serving_config.databricks_workspace_url string REMOTE +resources.model_serving_endpoints.*.endpoint_details.config.served_entities[*].external_model.google_cloud_vertex_ai_config *serving.GoogleCloudVertexAiConfig REMOTE +resources.model_serving_endpoints.*.endpoint_details.config.served_entities[*].external_model.google_cloud_vertex_ai_config.private_key string REMOTE +resources.model_serving_endpoints.*.endpoint_details.config.served_entities[*].external_model.google_cloud_vertex_ai_config.private_key_plaintext string REMOTE +resources.model_serving_endpoints.*.endpoint_details.config.served_entities[*].external_model.google_cloud_vertex_ai_config.project_id string REMOTE +resources.model_serving_endpoints.*.endpoint_details.config.served_entities[*].external_model.google_cloud_vertex_ai_config.region string REMOTE +resources.model_serving_endpoints.*.endpoint_details.config.served_entities[*].external_model.name string REMOTE +resources.model_serving_endpoints.*.endpoint_details.config.served_entities[*].external_model.openai_config *serving.OpenAiConfig REMOTE +resources.model_serving_endpoints.*.endpoint_details.config.served_entities[*].external_model.openai_config.microsoft_entra_client_id string REMOTE +resources.model_serving_endpoints.*.endpoint_details.config.served_entities[*].external_model.openai_config.microsoft_entra_client_secret string REMOTE +resources.model_serving_endpoints.*.endpoint_details.config.served_entities[*].external_model.openai_config.microsoft_entra_client_secret_plaintext string REMOTE +resources.model_serving_endpoints.*.endpoint_details.config.served_entities[*].external_model.openai_config.microsoft_entra_tenant_id string REMOTE +resources.model_serving_endpoints.*.endpoint_details.config.served_entities[*].external_model.openai_config.openai_api_base string REMOTE +resources.model_serving_endpoints.*.endpoint_details.config.served_entities[*].external_model.openai_config.openai_api_key string REMOTE +resources.model_serving_endpoints.*.endpoint_details.config.served_entities[*].external_model.openai_config.openai_api_key_plaintext string REMOTE +resources.model_serving_endpoints.*.endpoint_details.config.served_entities[*].external_model.openai_config.openai_api_type string REMOTE +resources.model_serving_endpoints.*.endpoint_details.config.served_entities[*].external_model.openai_config.openai_api_version string REMOTE +resources.model_serving_endpoints.*.endpoint_details.config.served_entities[*].external_model.openai_config.openai_deployment_name string REMOTE +resources.model_serving_endpoints.*.endpoint_details.config.served_entities[*].external_model.openai_config.openai_organization string REMOTE +resources.model_serving_endpoints.*.endpoint_details.config.served_entities[*].external_model.palm_config *serving.PaLmConfig REMOTE +resources.model_serving_endpoints.*.endpoint_details.config.served_entities[*].external_model.palm_config.palm_api_key string REMOTE +resources.model_serving_endpoints.*.endpoint_details.config.served_entities[*].external_model.palm_config.palm_api_key_plaintext string REMOTE +resources.model_serving_endpoints.*.endpoint_details.config.served_entities[*].external_model.provider serving.ExternalModelProvider REMOTE +resources.model_serving_endpoints.*.endpoint_details.config.served_entities[*].external_model.task string REMOTE +resources.model_serving_endpoints.*.endpoint_details.config.served_entities[*].foundation_model *serving.FoundationModel REMOTE +resources.model_serving_endpoints.*.endpoint_details.config.served_entities[*].foundation_model.description string REMOTE +resources.model_serving_endpoints.*.endpoint_details.config.served_entities[*].foundation_model.display_name string REMOTE +resources.model_serving_endpoints.*.endpoint_details.config.served_entities[*].foundation_model.docs string REMOTE +resources.model_serving_endpoints.*.endpoint_details.config.served_entities[*].foundation_model.name string REMOTE +resources.model_serving_endpoints.*.endpoint_details.config.served_entities[*].instance_profile_arn string REMOTE +resources.model_serving_endpoints.*.endpoint_details.config.served_entities[*].max_provisioned_concurrency int REMOTE +resources.model_serving_endpoints.*.endpoint_details.config.served_entities[*].max_provisioned_throughput int REMOTE +resources.model_serving_endpoints.*.endpoint_details.config.served_entities[*].min_provisioned_concurrency int REMOTE +resources.model_serving_endpoints.*.endpoint_details.config.served_entities[*].min_provisioned_throughput int REMOTE +resources.model_serving_endpoints.*.endpoint_details.config.served_entities[*].name string REMOTE +resources.model_serving_endpoints.*.endpoint_details.config.served_entities[*].provisioned_model_units int64 REMOTE +resources.model_serving_endpoints.*.endpoint_details.config.served_entities[*].scale_to_zero_enabled bool REMOTE +resources.model_serving_endpoints.*.endpoint_details.config.served_entities[*].state *serving.ServedModelState REMOTE +resources.model_serving_endpoints.*.endpoint_details.config.served_entities[*].state.deployment serving.ServedModelStateDeployment REMOTE +resources.model_serving_endpoints.*.endpoint_details.config.served_entities[*].state.deployment_state_message string REMOTE +resources.model_serving_endpoints.*.endpoint_details.config.served_entities[*].workload_size string REMOTE +resources.model_serving_endpoints.*.endpoint_details.config.served_entities[*].workload_type serving.ServingModelWorkloadType REMOTE +resources.model_serving_endpoints.*.endpoint_details.config.served_models []serving.ServedModelOutput REMOTE +resources.model_serving_endpoints.*.endpoint_details.config.served_models[*] serving.ServedModelOutput REMOTE +resources.model_serving_endpoints.*.endpoint_details.config.served_models[*].burst_scaling_enabled bool REMOTE +resources.model_serving_endpoints.*.endpoint_details.config.served_models[*].creation_timestamp int64 REMOTE +resources.model_serving_endpoints.*.endpoint_details.config.served_models[*].creator string REMOTE +resources.model_serving_endpoints.*.endpoint_details.config.served_models[*].environment_vars map[string]string REMOTE +resources.model_serving_endpoints.*.endpoint_details.config.served_models[*].environment_vars.* string REMOTE +resources.model_serving_endpoints.*.endpoint_details.config.served_models[*].instance_profile_arn string REMOTE +resources.model_serving_endpoints.*.endpoint_details.config.served_models[*].max_provisioned_concurrency int REMOTE +resources.model_serving_endpoints.*.endpoint_details.config.served_models[*].min_provisioned_concurrency int REMOTE +resources.model_serving_endpoints.*.endpoint_details.config.served_models[*].model_name string REMOTE +resources.model_serving_endpoints.*.endpoint_details.config.served_models[*].model_version string REMOTE +resources.model_serving_endpoints.*.endpoint_details.config.served_models[*].name string REMOTE +resources.model_serving_endpoints.*.endpoint_details.config.served_models[*].provisioned_model_units int64 REMOTE +resources.model_serving_endpoints.*.endpoint_details.config.served_models[*].scale_to_zero_enabled bool REMOTE +resources.model_serving_endpoints.*.endpoint_details.config.served_models[*].state *serving.ServedModelState REMOTE +resources.model_serving_endpoints.*.endpoint_details.config.served_models[*].state.deployment serving.ServedModelStateDeployment REMOTE +resources.model_serving_endpoints.*.endpoint_details.config.served_models[*].state.deployment_state_message string REMOTE +resources.model_serving_endpoints.*.endpoint_details.config.served_models[*].workload_size string REMOTE +resources.model_serving_endpoints.*.endpoint_details.config.served_models[*].workload_type serving.ServingModelWorkloadType REMOTE +resources.model_serving_endpoints.*.endpoint_details.config.traffic_config *serving.TrafficConfig REMOTE +resources.model_serving_endpoints.*.endpoint_details.config.traffic_config.routes []serving.Route REMOTE +resources.model_serving_endpoints.*.endpoint_details.config.traffic_config.routes[*] serving.Route REMOTE +resources.model_serving_endpoints.*.endpoint_details.config.traffic_config.routes[*].served_entity_name string REMOTE +resources.model_serving_endpoints.*.endpoint_details.config.traffic_config.routes[*].served_model_name string REMOTE +resources.model_serving_endpoints.*.endpoint_details.config.traffic_config.routes[*].traffic_percentage int REMOTE +resources.model_serving_endpoints.*.endpoint_details.creation_timestamp int64 REMOTE +resources.model_serving_endpoints.*.endpoint_details.creator string REMOTE +resources.model_serving_endpoints.*.endpoint_details.data_plane_info *serving.ModelDataPlaneInfo REMOTE +resources.model_serving_endpoints.*.endpoint_details.data_plane_info.query_info *serving.DataPlaneInfo REMOTE +resources.model_serving_endpoints.*.endpoint_details.data_plane_info.query_info.authorization_details string REMOTE +resources.model_serving_endpoints.*.endpoint_details.data_plane_info.query_info.endpoint_url string REMOTE +resources.model_serving_endpoints.*.endpoint_details.description string REMOTE +resources.model_serving_endpoints.*.endpoint_details.email_notifications *serving.EmailNotifications REMOTE +resources.model_serving_endpoints.*.endpoint_details.email_notifications.on_update_failure []string REMOTE +resources.model_serving_endpoints.*.endpoint_details.email_notifications.on_update_failure[*] string REMOTE +resources.model_serving_endpoints.*.endpoint_details.email_notifications.on_update_success []string REMOTE +resources.model_serving_endpoints.*.endpoint_details.email_notifications.on_update_success[*] string REMOTE +resources.model_serving_endpoints.*.endpoint_details.endpoint_url string REMOTE +resources.model_serving_endpoints.*.endpoint_details.id string REMOTE +resources.model_serving_endpoints.*.endpoint_details.last_updated_timestamp int64 REMOTE +resources.model_serving_endpoints.*.endpoint_details.name string REMOTE +resources.model_serving_endpoints.*.endpoint_details.pending_config *serving.EndpointPendingConfig REMOTE +resources.model_serving_endpoints.*.endpoint_details.pending_config.auto_capture_config *serving.AutoCaptureConfigOutput REMOTE +resources.model_serving_endpoints.*.endpoint_details.pending_config.auto_capture_config.catalog_name string REMOTE +resources.model_serving_endpoints.*.endpoint_details.pending_config.auto_capture_config.enabled bool REMOTE +resources.model_serving_endpoints.*.endpoint_details.pending_config.auto_capture_config.schema_name string REMOTE +resources.model_serving_endpoints.*.endpoint_details.pending_config.auto_capture_config.state *serving.AutoCaptureState REMOTE +resources.model_serving_endpoints.*.endpoint_details.pending_config.auto_capture_config.state.payload_table *serving.PayloadTable REMOTE +resources.model_serving_endpoints.*.endpoint_details.pending_config.auto_capture_config.state.payload_table.name string REMOTE +resources.model_serving_endpoints.*.endpoint_details.pending_config.auto_capture_config.state.payload_table.status string REMOTE +resources.model_serving_endpoints.*.endpoint_details.pending_config.auto_capture_config.state.payload_table.status_message string REMOTE +resources.model_serving_endpoints.*.endpoint_details.pending_config.auto_capture_config.table_name_prefix string REMOTE +resources.model_serving_endpoints.*.endpoint_details.pending_config.config_version int REMOTE +resources.model_serving_endpoints.*.endpoint_details.pending_config.served_entities []serving.ServedEntityOutput REMOTE +resources.model_serving_endpoints.*.endpoint_details.pending_config.served_entities[*] serving.ServedEntityOutput REMOTE +resources.model_serving_endpoints.*.endpoint_details.pending_config.served_entities[*].burst_scaling_enabled bool REMOTE +resources.model_serving_endpoints.*.endpoint_details.pending_config.served_entities[*].creation_timestamp int64 REMOTE +resources.model_serving_endpoints.*.endpoint_details.pending_config.served_entities[*].creator string REMOTE +resources.model_serving_endpoints.*.endpoint_details.pending_config.served_entities[*].entity_name string REMOTE +resources.model_serving_endpoints.*.endpoint_details.pending_config.served_entities[*].entity_version string REMOTE +resources.model_serving_endpoints.*.endpoint_details.pending_config.served_entities[*].environment_vars map[string]string REMOTE +resources.model_serving_endpoints.*.endpoint_details.pending_config.served_entities[*].environment_vars.* string REMOTE +resources.model_serving_endpoints.*.endpoint_details.pending_config.served_entities[*].external_model *serving.ExternalModel REMOTE +resources.model_serving_endpoints.*.endpoint_details.pending_config.served_entities[*].external_model.ai21labs_config *serving.Ai21LabsConfig REMOTE +resources.model_serving_endpoints.*.endpoint_details.pending_config.served_entities[*].external_model.ai21labs_config.ai21labs_api_key string REMOTE +resources.model_serving_endpoints.*.endpoint_details.pending_config.served_entities[*].external_model.ai21labs_config.ai21labs_api_key_plaintext string REMOTE +resources.model_serving_endpoints.*.endpoint_details.pending_config.served_entities[*].external_model.amazon_bedrock_config *serving.AmazonBedrockConfig REMOTE +resources.model_serving_endpoints.*.endpoint_details.pending_config.served_entities[*].external_model.amazon_bedrock_config.aws_access_key_id string REMOTE +resources.model_serving_endpoints.*.endpoint_details.pending_config.served_entities[*].external_model.amazon_bedrock_config.aws_access_key_id_plaintext string REMOTE +resources.model_serving_endpoints.*.endpoint_details.pending_config.served_entities[*].external_model.amazon_bedrock_config.aws_region string REMOTE +resources.model_serving_endpoints.*.endpoint_details.pending_config.served_entities[*].external_model.amazon_bedrock_config.aws_secret_access_key string REMOTE +resources.model_serving_endpoints.*.endpoint_details.pending_config.served_entities[*].external_model.amazon_bedrock_config.aws_secret_access_key_plaintext string REMOTE +resources.model_serving_endpoints.*.endpoint_details.pending_config.served_entities[*].external_model.amazon_bedrock_config.bedrock_provider serving.AmazonBedrockConfigBedrockProvider REMOTE +resources.model_serving_endpoints.*.endpoint_details.pending_config.served_entities[*].external_model.amazon_bedrock_config.instance_profile_arn string REMOTE +resources.model_serving_endpoints.*.endpoint_details.pending_config.served_entities[*].external_model.anthropic_config *serving.AnthropicConfig REMOTE +resources.model_serving_endpoints.*.endpoint_details.pending_config.served_entities[*].external_model.anthropic_config.anthropic_api_key string REMOTE +resources.model_serving_endpoints.*.endpoint_details.pending_config.served_entities[*].external_model.anthropic_config.anthropic_api_key_plaintext string REMOTE +resources.model_serving_endpoints.*.endpoint_details.pending_config.served_entities[*].external_model.cohere_config *serving.CohereConfig REMOTE +resources.model_serving_endpoints.*.endpoint_details.pending_config.served_entities[*].external_model.cohere_config.cohere_api_base string REMOTE +resources.model_serving_endpoints.*.endpoint_details.pending_config.served_entities[*].external_model.cohere_config.cohere_api_key string REMOTE +resources.model_serving_endpoints.*.endpoint_details.pending_config.served_entities[*].external_model.cohere_config.cohere_api_key_plaintext string REMOTE +resources.model_serving_endpoints.*.endpoint_details.pending_config.served_entities[*].external_model.custom_provider_config *serving.CustomProviderConfig REMOTE +resources.model_serving_endpoints.*.endpoint_details.pending_config.served_entities[*].external_model.custom_provider_config.api_key_auth *serving.ApiKeyAuth REMOTE +resources.model_serving_endpoints.*.endpoint_details.pending_config.served_entities[*].external_model.custom_provider_config.api_key_auth.key string REMOTE +resources.model_serving_endpoints.*.endpoint_details.pending_config.served_entities[*].external_model.custom_provider_config.api_key_auth.value string REMOTE +resources.model_serving_endpoints.*.endpoint_details.pending_config.served_entities[*].external_model.custom_provider_config.api_key_auth.value_plaintext string REMOTE +resources.model_serving_endpoints.*.endpoint_details.pending_config.served_entities[*].external_model.custom_provider_config.bearer_token_auth *serving.BearerTokenAuth REMOTE +resources.model_serving_endpoints.*.endpoint_details.pending_config.served_entities[*].external_model.custom_provider_config.bearer_token_auth.token string REMOTE +resources.model_serving_endpoints.*.endpoint_details.pending_config.served_entities[*].external_model.custom_provider_config.bearer_token_auth.token_plaintext string REMOTE +resources.model_serving_endpoints.*.endpoint_details.pending_config.served_entities[*].external_model.custom_provider_config.custom_provider_url string REMOTE +resources.model_serving_endpoints.*.endpoint_details.pending_config.served_entities[*].external_model.databricks_model_serving_config *serving.DatabricksModelServingConfig REMOTE +resources.model_serving_endpoints.*.endpoint_details.pending_config.served_entities[*].external_model.databricks_model_serving_config.databricks_api_token string REMOTE +resources.model_serving_endpoints.*.endpoint_details.pending_config.served_entities[*].external_model.databricks_model_serving_config.databricks_api_token_plaintext string REMOTE +resources.model_serving_endpoints.*.endpoint_details.pending_config.served_entities[*].external_model.databricks_model_serving_config.databricks_workspace_url string REMOTE +resources.model_serving_endpoints.*.endpoint_details.pending_config.served_entities[*].external_model.google_cloud_vertex_ai_config *serving.GoogleCloudVertexAiConfig REMOTE +resources.model_serving_endpoints.*.endpoint_details.pending_config.served_entities[*].external_model.google_cloud_vertex_ai_config.private_key string REMOTE +resources.model_serving_endpoints.*.endpoint_details.pending_config.served_entities[*].external_model.google_cloud_vertex_ai_config.private_key_plaintext string REMOTE +resources.model_serving_endpoints.*.endpoint_details.pending_config.served_entities[*].external_model.google_cloud_vertex_ai_config.project_id string REMOTE +resources.model_serving_endpoints.*.endpoint_details.pending_config.served_entities[*].external_model.google_cloud_vertex_ai_config.region string REMOTE +resources.model_serving_endpoints.*.endpoint_details.pending_config.served_entities[*].external_model.name string REMOTE +resources.model_serving_endpoints.*.endpoint_details.pending_config.served_entities[*].external_model.openai_config *serving.OpenAiConfig REMOTE +resources.model_serving_endpoints.*.endpoint_details.pending_config.served_entities[*].external_model.openai_config.microsoft_entra_client_id string REMOTE +resources.model_serving_endpoints.*.endpoint_details.pending_config.served_entities[*].external_model.openai_config.microsoft_entra_client_secret string REMOTE +resources.model_serving_endpoints.*.endpoint_details.pending_config.served_entities[*].external_model.openai_config.microsoft_entra_client_secret_plaintext string REMOTE +resources.model_serving_endpoints.*.endpoint_details.pending_config.served_entities[*].external_model.openai_config.microsoft_entra_tenant_id string REMOTE +resources.model_serving_endpoints.*.endpoint_details.pending_config.served_entities[*].external_model.openai_config.openai_api_base string REMOTE +resources.model_serving_endpoints.*.endpoint_details.pending_config.served_entities[*].external_model.openai_config.openai_api_key string REMOTE +resources.model_serving_endpoints.*.endpoint_details.pending_config.served_entities[*].external_model.openai_config.openai_api_key_plaintext string REMOTE +resources.model_serving_endpoints.*.endpoint_details.pending_config.served_entities[*].external_model.openai_config.openai_api_type string REMOTE +resources.model_serving_endpoints.*.endpoint_details.pending_config.served_entities[*].external_model.openai_config.openai_api_version string REMOTE +resources.model_serving_endpoints.*.endpoint_details.pending_config.served_entities[*].external_model.openai_config.openai_deployment_name string REMOTE +resources.model_serving_endpoints.*.endpoint_details.pending_config.served_entities[*].external_model.openai_config.openai_organization string REMOTE +resources.model_serving_endpoints.*.endpoint_details.pending_config.served_entities[*].external_model.palm_config *serving.PaLmConfig REMOTE +resources.model_serving_endpoints.*.endpoint_details.pending_config.served_entities[*].external_model.palm_config.palm_api_key string REMOTE +resources.model_serving_endpoints.*.endpoint_details.pending_config.served_entities[*].external_model.palm_config.palm_api_key_plaintext string REMOTE +resources.model_serving_endpoints.*.endpoint_details.pending_config.served_entities[*].external_model.provider serving.ExternalModelProvider REMOTE +resources.model_serving_endpoints.*.endpoint_details.pending_config.served_entities[*].external_model.task string REMOTE +resources.model_serving_endpoints.*.endpoint_details.pending_config.served_entities[*].foundation_model *serving.FoundationModel REMOTE +resources.model_serving_endpoints.*.endpoint_details.pending_config.served_entities[*].foundation_model.description string REMOTE +resources.model_serving_endpoints.*.endpoint_details.pending_config.served_entities[*].foundation_model.display_name string REMOTE +resources.model_serving_endpoints.*.endpoint_details.pending_config.served_entities[*].foundation_model.docs string REMOTE +resources.model_serving_endpoints.*.endpoint_details.pending_config.served_entities[*].foundation_model.name string REMOTE +resources.model_serving_endpoints.*.endpoint_details.pending_config.served_entities[*].instance_profile_arn string REMOTE +resources.model_serving_endpoints.*.endpoint_details.pending_config.served_entities[*].max_provisioned_concurrency int REMOTE +resources.model_serving_endpoints.*.endpoint_details.pending_config.served_entities[*].max_provisioned_throughput int REMOTE +resources.model_serving_endpoints.*.endpoint_details.pending_config.served_entities[*].min_provisioned_concurrency int REMOTE +resources.model_serving_endpoints.*.endpoint_details.pending_config.served_entities[*].min_provisioned_throughput int REMOTE +resources.model_serving_endpoints.*.endpoint_details.pending_config.served_entities[*].name string REMOTE +resources.model_serving_endpoints.*.endpoint_details.pending_config.served_entities[*].provisioned_model_units int64 REMOTE +resources.model_serving_endpoints.*.endpoint_details.pending_config.served_entities[*].scale_to_zero_enabled bool REMOTE +resources.model_serving_endpoints.*.endpoint_details.pending_config.served_entities[*].state *serving.ServedModelState REMOTE +resources.model_serving_endpoints.*.endpoint_details.pending_config.served_entities[*].state.deployment serving.ServedModelStateDeployment REMOTE +resources.model_serving_endpoints.*.endpoint_details.pending_config.served_entities[*].state.deployment_state_message string REMOTE +resources.model_serving_endpoints.*.endpoint_details.pending_config.served_entities[*].workload_size string REMOTE +resources.model_serving_endpoints.*.endpoint_details.pending_config.served_entities[*].workload_type serving.ServingModelWorkloadType REMOTE +resources.model_serving_endpoints.*.endpoint_details.pending_config.served_models []serving.ServedModelOutput REMOTE +resources.model_serving_endpoints.*.endpoint_details.pending_config.served_models[*] serving.ServedModelOutput REMOTE +resources.model_serving_endpoints.*.endpoint_details.pending_config.served_models[*].burst_scaling_enabled bool REMOTE +resources.model_serving_endpoints.*.endpoint_details.pending_config.served_models[*].creation_timestamp int64 REMOTE +resources.model_serving_endpoints.*.endpoint_details.pending_config.served_models[*].creator string REMOTE +resources.model_serving_endpoints.*.endpoint_details.pending_config.served_models[*].environment_vars map[string]string REMOTE +resources.model_serving_endpoints.*.endpoint_details.pending_config.served_models[*].environment_vars.* string REMOTE +resources.model_serving_endpoints.*.endpoint_details.pending_config.served_models[*].instance_profile_arn string REMOTE +resources.model_serving_endpoints.*.endpoint_details.pending_config.served_models[*].max_provisioned_concurrency int REMOTE +resources.model_serving_endpoints.*.endpoint_details.pending_config.served_models[*].min_provisioned_concurrency int REMOTE +resources.model_serving_endpoints.*.endpoint_details.pending_config.served_models[*].model_name string REMOTE +resources.model_serving_endpoints.*.endpoint_details.pending_config.served_models[*].model_version string REMOTE +resources.model_serving_endpoints.*.endpoint_details.pending_config.served_models[*].name string REMOTE +resources.model_serving_endpoints.*.endpoint_details.pending_config.served_models[*].provisioned_model_units int64 REMOTE +resources.model_serving_endpoints.*.endpoint_details.pending_config.served_models[*].scale_to_zero_enabled bool REMOTE +resources.model_serving_endpoints.*.endpoint_details.pending_config.served_models[*].state *serving.ServedModelState REMOTE +resources.model_serving_endpoints.*.endpoint_details.pending_config.served_models[*].state.deployment serving.ServedModelStateDeployment REMOTE +resources.model_serving_endpoints.*.endpoint_details.pending_config.served_models[*].state.deployment_state_message string REMOTE +resources.model_serving_endpoints.*.endpoint_details.pending_config.served_models[*].workload_size string REMOTE +resources.model_serving_endpoints.*.endpoint_details.pending_config.served_models[*].workload_type serving.ServingModelWorkloadType REMOTE +resources.model_serving_endpoints.*.endpoint_details.pending_config.start_time int64 REMOTE +resources.model_serving_endpoints.*.endpoint_details.pending_config.traffic_config *serving.TrafficConfig REMOTE +resources.model_serving_endpoints.*.endpoint_details.pending_config.traffic_config.routes []serving.Route REMOTE +resources.model_serving_endpoints.*.endpoint_details.pending_config.traffic_config.routes[*] serving.Route REMOTE +resources.model_serving_endpoints.*.endpoint_details.pending_config.traffic_config.routes[*].served_entity_name string REMOTE +resources.model_serving_endpoints.*.endpoint_details.pending_config.traffic_config.routes[*].served_model_name string REMOTE +resources.model_serving_endpoints.*.endpoint_details.pending_config.traffic_config.routes[*].traffic_percentage int REMOTE +resources.model_serving_endpoints.*.endpoint_details.permission_level serving.ServingEndpointDetailedPermissionLevel REMOTE +resources.model_serving_endpoints.*.endpoint_details.route_optimized bool REMOTE +resources.model_serving_endpoints.*.endpoint_details.state *serving.EndpointState REMOTE +resources.model_serving_endpoints.*.endpoint_details.state.config_update serving.EndpointStateConfigUpdate REMOTE +resources.model_serving_endpoints.*.endpoint_details.state.ready serving.EndpointStateReady REMOTE +resources.model_serving_endpoints.*.endpoint_details.tags []serving.EndpointTag REMOTE +resources.model_serving_endpoints.*.endpoint_details.tags[*] serving.EndpointTag REMOTE +resources.model_serving_endpoints.*.endpoint_details.tags[*].key string REMOTE +resources.model_serving_endpoints.*.endpoint_details.tags[*].value string REMOTE +resources.model_serving_endpoints.*.endpoint_details.task string REMOTE +resources.model_serving_endpoints.*.endpoint_id string REMOTE +resources.model_serving_endpoints.*.id string INPUT +resources.model_serving_endpoints.*.lifecycle resources.Lifecycle INPUT +resources.model_serving_endpoints.*.lifecycle.prevent_destroy bool INPUT +resources.model_serving_endpoints.*.modified_status string INPUT +resources.model_serving_endpoints.*.name string INPUT STATE +resources.model_serving_endpoints.*.rate_limits []serving.RateLimit INPUT STATE +resources.model_serving_endpoints.*.rate_limits[*] serving.RateLimit INPUT STATE +resources.model_serving_endpoints.*.rate_limits[*].calls int64 INPUT STATE +resources.model_serving_endpoints.*.rate_limits[*].key serving.RateLimitKey INPUT STATE +resources.model_serving_endpoints.*.rate_limits[*].renewal_period serving.RateLimitRenewalPeriod INPUT STATE +resources.model_serving_endpoints.*.route_optimized bool INPUT STATE +resources.model_serving_endpoints.*.tags []serving.EndpointTag INPUT STATE +resources.model_serving_endpoints.*.tags[*] serving.EndpointTag INPUT STATE +resources.model_serving_endpoints.*.tags[*].key string INPUT STATE +resources.model_serving_endpoints.*.tags[*].value string INPUT STATE +resources.model_serving_endpoints.*.url string INPUT +resources.model_serving_endpoints.*.permissions.object_id string ALL +resources.model_serving_endpoints.*.permissions[*] dresources.StatePermission ALL +resources.model_serving_endpoints.*.permissions[*].group_name string ALL +resources.model_serving_endpoints.*.permissions[*].level iam.PermissionLevel ALL +resources.model_serving_endpoints.*.permissions[*].service_principal_name string ALL +resources.model_serving_endpoints.*.permissions[*].user_name string ALL +resources.models.*.creation_timestamp int64 REMOTE +resources.models.*.description string ALL +resources.models.*.id string INPUT REMOTE +resources.models.*.last_updated_timestamp int64 REMOTE +resources.models.*.latest_versions []ml.ModelVersion REMOTE +resources.models.*.latest_versions[*] ml.ModelVersion REMOTE +resources.models.*.latest_versions[*].creation_timestamp int64 REMOTE +resources.models.*.latest_versions[*].current_stage string REMOTE +resources.models.*.latest_versions[*].description string REMOTE +resources.models.*.latest_versions[*].last_updated_timestamp int64 REMOTE +resources.models.*.latest_versions[*].name string REMOTE +resources.models.*.latest_versions[*].run_id string REMOTE +resources.models.*.latest_versions[*].run_link string REMOTE +resources.models.*.latest_versions[*].source string REMOTE +resources.models.*.latest_versions[*].status ml.ModelVersionStatus REMOTE +resources.models.*.latest_versions[*].status_message string REMOTE +resources.models.*.latest_versions[*].tags []ml.ModelVersionTag REMOTE +resources.models.*.latest_versions[*].tags[*] ml.ModelVersionTag REMOTE +resources.models.*.latest_versions[*].tags[*].key string REMOTE +resources.models.*.latest_versions[*].tags[*].value string REMOTE +resources.models.*.latest_versions[*].user_id string REMOTE +resources.models.*.latest_versions[*].version string REMOTE +resources.models.*.lifecycle resources.Lifecycle INPUT +resources.models.*.lifecycle.prevent_destroy bool INPUT +resources.models.*.model_id string REMOTE +resources.models.*.modified_status string INPUT +resources.models.*.name string ALL +resources.models.*.permission_level ml.PermissionLevel REMOTE +resources.models.*.tags []ml.ModelTag ALL +resources.models.*.tags[*] ml.ModelTag ALL +resources.models.*.tags[*].key string ALL +resources.models.*.tags[*].value string ALL +resources.models.*.url string INPUT +resources.models.*.user_id string REMOTE +resources.models.*.permissions.object_id string ALL +resources.models.*.permissions[*] dresources.StatePermission ALL +resources.models.*.permissions[*].group_name string ALL +resources.models.*.permissions[*].level iam.PermissionLevel ALL +resources.models.*.permissions[*].service_principal_name string ALL +resources.models.*.permissions[*].user_name string ALL +resources.pipelines.*.allow_duplicate_names bool ALL +resources.pipelines.*.budget_policy_id string ALL +resources.pipelines.*.catalog string ALL +resources.pipelines.*.cause string REMOTE +resources.pipelines.*.channel string ALL +resources.pipelines.*.cluster_id string REMOTE +resources.pipelines.*.clusters []pipelines.PipelineCluster ALL +resources.pipelines.*.clusters[*] pipelines.PipelineCluster ALL +resources.pipelines.*.clusters[*].apply_policy_default_values bool ALL +resources.pipelines.*.clusters[*].autoscale *pipelines.PipelineClusterAutoscale ALL +resources.pipelines.*.clusters[*].autoscale.max_workers int ALL +resources.pipelines.*.clusters[*].autoscale.min_workers int ALL +resources.pipelines.*.clusters[*].autoscale.mode pipelines.PipelineClusterAutoscaleMode ALL +resources.pipelines.*.clusters[*].aws_attributes *compute.AwsAttributes ALL +resources.pipelines.*.clusters[*].aws_attributes.availability compute.AwsAvailability ALL +resources.pipelines.*.clusters[*].aws_attributes.ebs_volume_count int ALL +resources.pipelines.*.clusters[*].aws_attributes.ebs_volume_iops int ALL +resources.pipelines.*.clusters[*].aws_attributes.ebs_volume_size int ALL +resources.pipelines.*.clusters[*].aws_attributes.ebs_volume_throughput int ALL +resources.pipelines.*.clusters[*].aws_attributes.ebs_volume_type compute.EbsVolumeType ALL +resources.pipelines.*.clusters[*].aws_attributes.first_on_demand int ALL +resources.pipelines.*.clusters[*].aws_attributes.instance_profile_arn string ALL +resources.pipelines.*.clusters[*].aws_attributes.spot_bid_price_percent int ALL +resources.pipelines.*.clusters[*].aws_attributes.zone_id string ALL +resources.pipelines.*.clusters[*].azure_attributes *compute.AzureAttributes ALL +resources.pipelines.*.clusters[*].azure_attributes.availability compute.AzureAvailability ALL +resources.pipelines.*.clusters[*].azure_attributes.first_on_demand int ALL +resources.pipelines.*.clusters[*].azure_attributes.log_analytics_info *compute.LogAnalyticsInfo ALL +resources.pipelines.*.clusters[*].azure_attributes.log_analytics_info.log_analytics_primary_key string ALL +resources.pipelines.*.clusters[*].azure_attributes.log_analytics_info.log_analytics_workspace_id string ALL +resources.pipelines.*.clusters[*].azure_attributes.spot_bid_max_price float64 ALL +resources.pipelines.*.clusters[*].cluster_log_conf *compute.ClusterLogConf ALL +resources.pipelines.*.clusters[*].cluster_log_conf.dbfs *compute.DbfsStorageInfo ALL +resources.pipelines.*.clusters[*].cluster_log_conf.dbfs.destination string ALL +resources.pipelines.*.clusters[*].cluster_log_conf.s3 *compute.S3StorageInfo ALL +resources.pipelines.*.clusters[*].cluster_log_conf.s3.canned_acl string ALL +resources.pipelines.*.clusters[*].cluster_log_conf.s3.destination string ALL +resources.pipelines.*.clusters[*].cluster_log_conf.s3.enable_encryption bool ALL +resources.pipelines.*.clusters[*].cluster_log_conf.s3.encryption_type string ALL +resources.pipelines.*.clusters[*].cluster_log_conf.s3.endpoint string ALL +resources.pipelines.*.clusters[*].cluster_log_conf.s3.kms_key string ALL +resources.pipelines.*.clusters[*].cluster_log_conf.s3.region string ALL +resources.pipelines.*.clusters[*].cluster_log_conf.volumes *compute.VolumesStorageInfo ALL +resources.pipelines.*.clusters[*].cluster_log_conf.volumes.destination string ALL +resources.pipelines.*.clusters[*].custom_tags map[string]string ALL +resources.pipelines.*.clusters[*].custom_tags.* string ALL +resources.pipelines.*.clusters[*].driver_instance_pool_id string ALL +resources.pipelines.*.clusters[*].driver_node_type_id string ALL +resources.pipelines.*.clusters[*].enable_local_disk_encryption bool ALL +resources.pipelines.*.clusters[*].gcp_attributes *compute.GcpAttributes ALL +resources.pipelines.*.clusters[*].gcp_attributes.availability compute.GcpAvailability ALL +resources.pipelines.*.clusters[*].gcp_attributes.boot_disk_size int ALL +resources.pipelines.*.clusters[*].gcp_attributes.confidential_compute_type compute.ConfidentialComputeType ALL +resources.pipelines.*.clusters[*].gcp_attributes.first_on_demand int ALL +resources.pipelines.*.clusters[*].gcp_attributes.google_service_account string ALL +resources.pipelines.*.clusters[*].gcp_attributes.local_ssd_count int ALL +resources.pipelines.*.clusters[*].gcp_attributes.use_preemptible_executors bool ALL +resources.pipelines.*.clusters[*].gcp_attributes.zone_id string ALL +resources.pipelines.*.clusters[*].init_scripts []compute.InitScriptInfo ALL +resources.pipelines.*.clusters[*].init_scripts[*] compute.InitScriptInfo ALL +resources.pipelines.*.clusters[*].init_scripts[*].abfss *compute.Adlsgen2Info ALL +resources.pipelines.*.clusters[*].init_scripts[*].abfss.destination string ALL +resources.pipelines.*.clusters[*].init_scripts[*].dbfs *compute.DbfsStorageInfo ALL +resources.pipelines.*.clusters[*].init_scripts[*].dbfs.destination string ALL +resources.pipelines.*.clusters[*].init_scripts[*].file *compute.LocalFileInfo ALL +resources.pipelines.*.clusters[*].init_scripts[*].file.destination string ALL +resources.pipelines.*.clusters[*].init_scripts[*].gcs *compute.GcsStorageInfo ALL +resources.pipelines.*.clusters[*].init_scripts[*].gcs.destination string ALL +resources.pipelines.*.clusters[*].init_scripts[*].s3 *compute.S3StorageInfo ALL +resources.pipelines.*.clusters[*].init_scripts[*].s3.canned_acl string ALL +resources.pipelines.*.clusters[*].init_scripts[*].s3.destination string ALL +resources.pipelines.*.clusters[*].init_scripts[*].s3.enable_encryption bool ALL +resources.pipelines.*.clusters[*].init_scripts[*].s3.encryption_type string ALL +resources.pipelines.*.clusters[*].init_scripts[*].s3.endpoint string ALL +resources.pipelines.*.clusters[*].init_scripts[*].s3.kms_key string ALL +resources.pipelines.*.clusters[*].init_scripts[*].s3.region string ALL +resources.pipelines.*.clusters[*].init_scripts[*].volumes *compute.VolumesStorageInfo ALL +resources.pipelines.*.clusters[*].init_scripts[*].volumes.destination string ALL +resources.pipelines.*.clusters[*].init_scripts[*].workspace *compute.WorkspaceStorageInfo ALL +resources.pipelines.*.clusters[*].init_scripts[*].workspace.destination string ALL +resources.pipelines.*.clusters[*].instance_pool_id string ALL +resources.pipelines.*.clusters[*].label string ALL +resources.pipelines.*.clusters[*].node_type_id string ALL +resources.pipelines.*.clusters[*].num_workers int ALL +resources.pipelines.*.clusters[*].policy_id string ALL +resources.pipelines.*.clusters[*].spark_conf map[string]string ALL +resources.pipelines.*.clusters[*].spark_conf.* string ALL +resources.pipelines.*.clusters[*].spark_env_vars map[string]string ALL +resources.pipelines.*.clusters[*].spark_env_vars.* string ALL +resources.pipelines.*.clusters[*].ssh_public_keys []string ALL +resources.pipelines.*.clusters[*].ssh_public_keys[*] string ALL +resources.pipelines.*.configuration map[string]string ALL +resources.pipelines.*.configuration.* string ALL +resources.pipelines.*.continuous bool ALL +resources.pipelines.*.creator_user_name string REMOTE +resources.pipelines.*.deployment *pipelines.PipelineDeployment ALL +resources.pipelines.*.deployment.kind pipelines.DeploymentKind ALL +resources.pipelines.*.deployment.metadata_file_path string ALL +resources.pipelines.*.development bool ALL +resources.pipelines.*.dry_run bool ALL +resources.pipelines.*.edition string ALL +resources.pipelines.*.effective_budget_policy_id string REMOTE +resources.pipelines.*.effective_publishing_mode pipelines.PublishingMode REMOTE +resources.pipelines.*.environment *pipelines.PipelinesEnvironment ALL +resources.pipelines.*.environment.dependencies []string ALL +resources.pipelines.*.environment.dependencies[*] string ALL +resources.pipelines.*.environment.environment_version string ALL +resources.pipelines.*.event_log *pipelines.EventLogSpec ALL +resources.pipelines.*.event_log.catalog string ALL +resources.pipelines.*.event_log.name string ALL +resources.pipelines.*.event_log.schema string ALL +resources.pipelines.*.filters *pipelines.Filters ALL +resources.pipelines.*.filters.exclude []string ALL +resources.pipelines.*.filters.exclude[*] string ALL +resources.pipelines.*.filters.include []string ALL +resources.pipelines.*.filters.include[*] string ALL +resources.pipelines.*.gateway_definition *pipelines.IngestionGatewayPipelineDefinition ALL +resources.pipelines.*.gateway_definition.connection_id string ALL +resources.pipelines.*.gateway_definition.connection_name string ALL +resources.pipelines.*.gateway_definition.connection_parameters *pipelines.ConnectionParameters ALL +resources.pipelines.*.gateway_definition.connection_parameters.source_catalog string ALL +resources.pipelines.*.gateway_definition.gateway_storage_catalog string ALL +resources.pipelines.*.gateway_definition.gateway_storage_name string ALL +resources.pipelines.*.gateway_definition.gateway_storage_schema string ALL +resources.pipelines.*.health pipelines.GetPipelineResponseHealth REMOTE +resources.pipelines.*.id string ALL +resources.pipelines.*.ingestion_definition *pipelines.IngestionPipelineDefinition ALL +resources.pipelines.*.ingestion_definition.connection_name string ALL +resources.pipelines.*.ingestion_definition.connector_type pipelines.ConnectorType ALL +resources.pipelines.*.ingestion_definition.data_staging_options *pipelines.DataStagingOptions ALL +resources.pipelines.*.ingestion_definition.data_staging_options.catalog_name string ALL +resources.pipelines.*.ingestion_definition.data_staging_options.schema_name string ALL +resources.pipelines.*.ingestion_definition.data_staging_options.volume_name string ALL +resources.pipelines.*.ingestion_definition.full_refresh_window *pipelines.OperationTimeWindow ALL +resources.pipelines.*.ingestion_definition.full_refresh_window.days_of_week []pipelines.DayOfWeek ALL +resources.pipelines.*.ingestion_definition.full_refresh_window.days_of_week[*] pipelines.DayOfWeek ALL +resources.pipelines.*.ingestion_definition.full_refresh_window.start_hour int ALL +resources.pipelines.*.ingestion_definition.full_refresh_window.time_zone_id string ALL +resources.pipelines.*.ingestion_definition.ingest_from_uc_foreign_catalog bool ALL +resources.pipelines.*.ingestion_definition.ingestion_gateway_id string ALL +resources.pipelines.*.ingestion_definition.netsuite_jar_path string ALL +resources.pipelines.*.ingestion_definition.objects []pipelines.IngestionConfig ALL +resources.pipelines.*.ingestion_definition.objects[*] pipelines.IngestionConfig ALL +resources.pipelines.*.ingestion_definition.objects[*].report *pipelines.ReportSpec ALL +resources.pipelines.*.ingestion_definition.objects[*].report.destination_catalog string ALL +resources.pipelines.*.ingestion_definition.objects[*].report.destination_schema string ALL +resources.pipelines.*.ingestion_definition.objects[*].report.destination_table string ALL +resources.pipelines.*.ingestion_definition.objects[*].report.source_url string ALL +resources.pipelines.*.ingestion_definition.objects[*].report.table_configuration *pipelines.TableSpecificConfig ALL +resources.pipelines.*.ingestion_definition.objects[*].report.table_configuration.auto_full_refresh_policy *pipelines.AutoFullRefreshPolicy ALL +resources.pipelines.*.ingestion_definition.objects[*].report.table_configuration.auto_full_refresh_policy.enabled bool ALL +resources.pipelines.*.ingestion_definition.objects[*].report.table_configuration.auto_full_refresh_policy.min_interval_hours int ALL +resources.pipelines.*.ingestion_definition.objects[*].report.table_configuration.exclude_columns []string ALL +resources.pipelines.*.ingestion_definition.objects[*].report.table_configuration.exclude_columns[*] string ALL +resources.pipelines.*.ingestion_definition.objects[*].report.table_configuration.include_columns []string ALL +resources.pipelines.*.ingestion_definition.objects[*].report.table_configuration.include_columns[*] string ALL +resources.pipelines.*.ingestion_definition.objects[*].report.table_configuration.primary_keys []string ALL +resources.pipelines.*.ingestion_definition.objects[*].report.table_configuration.primary_keys[*] string ALL +resources.pipelines.*.ingestion_definition.objects[*].report.table_configuration.query_based_connector_config *pipelines.IngestionPipelineDefinitionTableSpecificConfigQueryBasedConnectorConfig ALL +resources.pipelines.*.ingestion_definition.objects[*].report.table_configuration.query_based_connector_config.cursor_columns []string ALL +resources.pipelines.*.ingestion_definition.objects[*].report.table_configuration.query_based_connector_config.cursor_columns[*] string ALL +resources.pipelines.*.ingestion_definition.objects[*].report.table_configuration.query_based_connector_config.deletion_condition string ALL +resources.pipelines.*.ingestion_definition.objects[*].report.table_configuration.query_based_connector_config.hard_deletion_sync_min_interval_in_seconds int64 ALL +resources.pipelines.*.ingestion_definition.objects[*].report.table_configuration.row_filter string ALL +resources.pipelines.*.ingestion_definition.objects[*].report.table_configuration.salesforce_include_formula_fields bool ALL +resources.pipelines.*.ingestion_definition.objects[*].report.table_configuration.scd_type pipelines.TableSpecificConfigScdType ALL +resources.pipelines.*.ingestion_definition.objects[*].report.table_configuration.sequence_by []string ALL +resources.pipelines.*.ingestion_definition.objects[*].report.table_configuration.sequence_by[*] string ALL +resources.pipelines.*.ingestion_definition.objects[*].report.table_configuration.workday_report_parameters *pipelines.IngestionPipelineDefinitionWorkdayReportParameters ALL +resources.pipelines.*.ingestion_definition.objects[*].report.table_configuration.workday_report_parameters.incremental bool ALL +resources.pipelines.*.ingestion_definition.objects[*].report.table_configuration.workday_report_parameters.parameters map[string]string ALL +resources.pipelines.*.ingestion_definition.objects[*].report.table_configuration.workday_report_parameters.parameters.* string ALL +resources.pipelines.*.ingestion_definition.objects[*].report.table_configuration.workday_report_parameters.report_parameters []pipelines.IngestionPipelineDefinitionWorkdayReportParametersQueryKeyValue ALL +resources.pipelines.*.ingestion_definition.objects[*].report.table_configuration.workday_report_parameters.report_parameters[*] pipelines.IngestionPipelineDefinitionWorkdayReportParametersQueryKeyValue ALL +resources.pipelines.*.ingestion_definition.objects[*].report.table_configuration.workday_report_parameters.report_parameters[*].key string ALL +resources.pipelines.*.ingestion_definition.objects[*].report.table_configuration.workday_report_parameters.report_parameters[*].value string ALL +resources.pipelines.*.ingestion_definition.objects[*].schema *pipelines.SchemaSpec ALL +resources.pipelines.*.ingestion_definition.objects[*].schema.connector_options *pipelines.ConnectorOptions ALL +resources.pipelines.*.ingestion_definition.objects[*].schema.connector_options.confluence_options *pipelines.ConfluenceConnectorOptions ALL +resources.pipelines.*.ingestion_definition.objects[*].schema.connector_options.confluence_options.include_confluence_spaces []string ALL +resources.pipelines.*.ingestion_definition.objects[*].schema.connector_options.confluence_options.include_confluence_spaces[*] string ALL +resources.pipelines.*.ingestion_definition.objects[*].schema.connector_options.gdrive_options *pipelines.GoogleDriveOptions ALL +resources.pipelines.*.ingestion_definition.objects[*].schema.connector_options.gdrive_options.entity_type pipelines.GoogleDriveOptionsGoogleDriveEntityType ALL +resources.pipelines.*.ingestion_definition.objects[*].schema.connector_options.gdrive_options.file_ingestion_options *pipelines.FileIngestionOptions ALL +resources.pipelines.*.ingestion_definition.objects[*].schema.connector_options.gdrive_options.file_ingestion_options.corrupt_record_column string ALL +resources.pipelines.*.ingestion_definition.objects[*].schema.connector_options.gdrive_options.file_ingestion_options.file_filters []pipelines.FileFilter ALL +resources.pipelines.*.ingestion_definition.objects[*].schema.connector_options.gdrive_options.file_ingestion_options.file_filters[*] pipelines.FileFilter ALL +resources.pipelines.*.ingestion_definition.objects[*].schema.connector_options.gdrive_options.file_ingestion_options.file_filters[*].modified_after string ALL +resources.pipelines.*.ingestion_definition.objects[*].schema.connector_options.gdrive_options.file_ingestion_options.file_filters[*].modified_before string ALL +resources.pipelines.*.ingestion_definition.objects[*].schema.connector_options.gdrive_options.file_ingestion_options.file_filters[*].path_filter string ALL +resources.pipelines.*.ingestion_definition.objects[*].schema.connector_options.gdrive_options.file_ingestion_options.format pipelines.FileIngestionOptionsFileFormat ALL +resources.pipelines.*.ingestion_definition.objects[*].schema.connector_options.gdrive_options.file_ingestion_options.format_options map[string]string ALL +resources.pipelines.*.ingestion_definition.objects[*].schema.connector_options.gdrive_options.file_ingestion_options.format_options.* string ALL +resources.pipelines.*.ingestion_definition.objects[*].schema.connector_options.gdrive_options.file_ingestion_options.ignore_corrupt_files bool ALL +resources.pipelines.*.ingestion_definition.objects[*].schema.connector_options.gdrive_options.file_ingestion_options.infer_column_types bool ALL +resources.pipelines.*.ingestion_definition.objects[*].schema.connector_options.gdrive_options.file_ingestion_options.reader_case_sensitive bool ALL +resources.pipelines.*.ingestion_definition.objects[*].schema.connector_options.gdrive_options.file_ingestion_options.rescued_data_column string ALL +resources.pipelines.*.ingestion_definition.objects[*].schema.connector_options.gdrive_options.file_ingestion_options.schema_evolution_mode pipelines.FileIngestionOptionsSchemaEvolutionMode ALL +resources.pipelines.*.ingestion_definition.objects[*].schema.connector_options.gdrive_options.file_ingestion_options.schema_hints string ALL +resources.pipelines.*.ingestion_definition.objects[*].schema.connector_options.gdrive_options.file_ingestion_options.single_variant_column string ALL +resources.pipelines.*.ingestion_definition.objects[*].schema.connector_options.gdrive_options.url string ALL +resources.pipelines.*.ingestion_definition.objects[*].schema.connector_options.google_ads_options *pipelines.GoogleAdsOptions ALL +resources.pipelines.*.ingestion_definition.objects[*].schema.connector_options.google_ads_options.lookback_window_days int ALL +resources.pipelines.*.ingestion_definition.objects[*].schema.connector_options.google_ads_options.manager_account_id string ALL +resources.pipelines.*.ingestion_definition.objects[*].schema.connector_options.google_ads_options.sync_start_date string ALL +resources.pipelines.*.ingestion_definition.objects[*].schema.connector_options.jira_options *pipelines.JiraConnectorOptions ALL +resources.pipelines.*.ingestion_definition.objects[*].schema.connector_options.jira_options.include_jira_spaces []string ALL +resources.pipelines.*.ingestion_definition.objects[*].schema.connector_options.jira_options.include_jira_spaces[*] string ALL +resources.pipelines.*.ingestion_definition.objects[*].schema.connector_options.kafka_options *pipelines.KafkaOptions ALL +resources.pipelines.*.ingestion_definition.objects[*].schema.connector_options.kafka_options.client_config map[string]string ALL +resources.pipelines.*.ingestion_definition.objects[*].schema.connector_options.kafka_options.client_config.* string ALL +resources.pipelines.*.ingestion_definition.objects[*].schema.connector_options.kafka_options.key_transformer *pipelines.Transformer ALL +resources.pipelines.*.ingestion_definition.objects[*].schema.connector_options.kafka_options.key_transformer.format pipelines.TransformerFormat ALL +resources.pipelines.*.ingestion_definition.objects[*].schema.connector_options.kafka_options.key_transformer.json_options *pipelines.JsonTransformerOptions ALL +resources.pipelines.*.ingestion_definition.objects[*].schema.connector_options.kafka_options.key_transformer.json_options.as_variant bool ALL +resources.pipelines.*.ingestion_definition.objects[*].schema.connector_options.kafka_options.key_transformer.json_options.schema string ALL +resources.pipelines.*.ingestion_definition.objects[*].schema.connector_options.kafka_options.key_transformer.json_options.schema_evolution_mode pipelines.FileIngestionOptionsSchemaEvolutionMode ALL +resources.pipelines.*.ingestion_definition.objects[*].schema.connector_options.kafka_options.key_transformer.json_options.schema_file_path string ALL +resources.pipelines.*.ingestion_definition.objects[*].schema.connector_options.kafka_options.key_transformer.json_options.schema_hints string ALL +resources.pipelines.*.ingestion_definition.objects[*].schema.connector_options.kafka_options.max_offsets_per_trigger int64 ALL +resources.pipelines.*.ingestion_definition.objects[*].schema.connector_options.kafka_options.starting_offset string ALL +resources.pipelines.*.ingestion_definition.objects[*].schema.connector_options.kafka_options.topic_pattern string ALL +resources.pipelines.*.ingestion_definition.objects[*].schema.connector_options.kafka_options.topics []string ALL +resources.pipelines.*.ingestion_definition.objects[*].schema.connector_options.kafka_options.topics[*] string ALL +resources.pipelines.*.ingestion_definition.objects[*].schema.connector_options.kafka_options.value_transformer *pipelines.Transformer ALL +resources.pipelines.*.ingestion_definition.objects[*].schema.connector_options.kafka_options.value_transformer.format pipelines.TransformerFormat ALL +resources.pipelines.*.ingestion_definition.objects[*].schema.connector_options.kafka_options.value_transformer.json_options *pipelines.JsonTransformerOptions ALL +resources.pipelines.*.ingestion_definition.objects[*].schema.connector_options.kafka_options.value_transformer.json_options.as_variant bool ALL +resources.pipelines.*.ingestion_definition.objects[*].schema.connector_options.kafka_options.value_transformer.json_options.schema string ALL +resources.pipelines.*.ingestion_definition.objects[*].schema.connector_options.kafka_options.value_transformer.json_options.schema_evolution_mode pipelines.FileIngestionOptionsSchemaEvolutionMode ALL +resources.pipelines.*.ingestion_definition.objects[*].schema.connector_options.kafka_options.value_transformer.json_options.schema_file_path string ALL +resources.pipelines.*.ingestion_definition.objects[*].schema.connector_options.kafka_options.value_transformer.json_options.schema_hints string ALL +resources.pipelines.*.ingestion_definition.objects[*].schema.connector_options.meta_ads_options *pipelines.MetaMarketingOptions ALL +resources.pipelines.*.ingestion_definition.objects[*].schema.connector_options.meta_ads_options.action_attribution_windows []string ALL +resources.pipelines.*.ingestion_definition.objects[*].schema.connector_options.meta_ads_options.action_attribution_windows[*] string ALL +resources.pipelines.*.ingestion_definition.objects[*].schema.connector_options.meta_ads_options.action_breakdowns []string ALL +resources.pipelines.*.ingestion_definition.objects[*].schema.connector_options.meta_ads_options.action_breakdowns[*] string ALL +resources.pipelines.*.ingestion_definition.objects[*].schema.connector_options.meta_ads_options.action_report_time string ALL +resources.pipelines.*.ingestion_definition.objects[*].schema.connector_options.meta_ads_options.breakdowns []string ALL +resources.pipelines.*.ingestion_definition.objects[*].schema.connector_options.meta_ads_options.breakdowns[*] string ALL +resources.pipelines.*.ingestion_definition.objects[*].schema.connector_options.meta_ads_options.custom_insights_lookback_window int ALL +resources.pipelines.*.ingestion_definition.objects[*].schema.connector_options.meta_ads_options.level string ALL +resources.pipelines.*.ingestion_definition.objects[*].schema.connector_options.meta_ads_options.start_date string ALL +resources.pipelines.*.ingestion_definition.objects[*].schema.connector_options.meta_ads_options.time_increment string ALL +resources.pipelines.*.ingestion_definition.objects[*].schema.connector_options.outlook_options *pipelines.OutlookOptions ALL +resources.pipelines.*.ingestion_definition.objects[*].schema.connector_options.outlook_options.attachment_mode pipelines.OutlookAttachmentMode ALL +resources.pipelines.*.ingestion_definition.objects[*].schema.connector_options.outlook_options.body_format pipelines.OutlookBodyFormat ALL +resources.pipelines.*.ingestion_definition.objects[*].schema.connector_options.outlook_options.folder_filter []string ALL +resources.pipelines.*.ingestion_definition.objects[*].schema.connector_options.outlook_options.folder_filter[*] string ALL +resources.pipelines.*.ingestion_definition.objects[*].schema.connector_options.outlook_options.include_folders []string ALL +resources.pipelines.*.ingestion_definition.objects[*].schema.connector_options.outlook_options.include_folders[*] string ALL +resources.pipelines.*.ingestion_definition.objects[*].schema.connector_options.outlook_options.include_mailboxes []string ALL +resources.pipelines.*.ingestion_definition.objects[*].schema.connector_options.outlook_options.include_mailboxes[*] string ALL +resources.pipelines.*.ingestion_definition.objects[*].schema.connector_options.outlook_options.include_senders []string ALL +resources.pipelines.*.ingestion_definition.objects[*].schema.connector_options.outlook_options.include_senders[*] string ALL +resources.pipelines.*.ingestion_definition.objects[*].schema.connector_options.outlook_options.include_subjects []string ALL +resources.pipelines.*.ingestion_definition.objects[*].schema.connector_options.outlook_options.include_subjects[*] string ALL +resources.pipelines.*.ingestion_definition.objects[*].schema.connector_options.outlook_options.sender_filter []string ALL +resources.pipelines.*.ingestion_definition.objects[*].schema.connector_options.outlook_options.sender_filter[*] string ALL +resources.pipelines.*.ingestion_definition.objects[*].schema.connector_options.outlook_options.start_date string ALL +resources.pipelines.*.ingestion_definition.objects[*].schema.connector_options.outlook_options.subject_filter []string ALL +resources.pipelines.*.ingestion_definition.objects[*].schema.connector_options.outlook_options.subject_filter[*] string ALL +resources.pipelines.*.ingestion_definition.objects[*].schema.connector_options.sharepoint_options *pipelines.SharepointOptions ALL +resources.pipelines.*.ingestion_definition.objects[*].schema.connector_options.sharepoint_options.entity_type pipelines.SharepointOptionsSharepointEntityType ALL +resources.pipelines.*.ingestion_definition.objects[*].schema.connector_options.sharepoint_options.file_ingestion_options *pipelines.FileIngestionOptions ALL +resources.pipelines.*.ingestion_definition.objects[*].schema.connector_options.sharepoint_options.file_ingestion_options.corrupt_record_column string ALL +resources.pipelines.*.ingestion_definition.objects[*].schema.connector_options.sharepoint_options.file_ingestion_options.file_filters []pipelines.FileFilter ALL +resources.pipelines.*.ingestion_definition.objects[*].schema.connector_options.sharepoint_options.file_ingestion_options.file_filters[*] pipelines.FileFilter ALL +resources.pipelines.*.ingestion_definition.objects[*].schema.connector_options.sharepoint_options.file_ingestion_options.file_filters[*].modified_after string ALL +resources.pipelines.*.ingestion_definition.objects[*].schema.connector_options.sharepoint_options.file_ingestion_options.file_filters[*].modified_before string ALL +resources.pipelines.*.ingestion_definition.objects[*].schema.connector_options.sharepoint_options.file_ingestion_options.file_filters[*].path_filter string ALL +resources.pipelines.*.ingestion_definition.objects[*].schema.connector_options.sharepoint_options.file_ingestion_options.format pipelines.FileIngestionOptionsFileFormat ALL +resources.pipelines.*.ingestion_definition.objects[*].schema.connector_options.sharepoint_options.file_ingestion_options.format_options map[string]string ALL +resources.pipelines.*.ingestion_definition.objects[*].schema.connector_options.sharepoint_options.file_ingestion_options.format_options.* string ALL +resources.pipelines.*.ingestion_definition.objects[*].schema.connector_options.sharepoint_options.file_ingestion_options.ignore_corrupt_files bool ALL +resources.pipelines.*.ingestion_definition.objects[*].schema.connector_options.sharepoint_options.file_ingestion_options.infer_column_types bool ALL +resources.pipelines.*.ingestion_definition.objects[*].schema.connector_options.sharepoint_options.file_ingestion_options.reader_case_sensitive bool ALL +resources.pipelines.*.ingestion_definition.objects[*].schema.connector_options.sharepoint_options.file_ingestion_options.rescued_data_column string ALL +resources.pipelines.*.ingestion_definition.objects[*].schema.connector_options.sharepoint_options.file_ingestion_options.schema_evolution_mode pipelines.FileIngestionOptionsSchemaEvolutionMode ALL +resources.pipelines.*.ingestion_definition.objects[*].schema.connector_options.sharepoint_options.file_ingestion_options.schema_hints string ALL +resources.pipelines.*.ingestion_definition.objects[*].schema.connector_options.sharepoint_options.file_ingestion_options.single_variant_column string ALL +resources.pipelines.*.ingestion_definition.objects[*].schema.connector_options.sharepoint_options.url string ALL +resources.pipelines.*.ingestion_definition.objects[*].schema.connector_options.smartsheet_options *pipelines.SmartsheetOptions ALL +resources.pipelines.*.ingestion_definition.objects[*].schema.connector_options.smartsheet_options.enforce_schema bool ALL +resources.pipelines.*.ingestion_definition.objects[*].schema.connector_options.tiktok_ads_options *pipelines.TikTokAdsOptions ALL +resources.pipelines.*.ingestion_definition.objects[*].schema.connector_options.tiktok_ads_options.data_level pipelines.TikTokAdsOptionsTikTokDataLevel ALL +resources.pipelines.*.ingestion_definition.objects[*].schema.connector_options.tiktok_ads_options.dimensions []string ALL +resources.pipelines.*.ingestion_definition.objects[*].schema.connector_options.tiktok_ads_options.dimensions[*] string ALL +resources.pipelines.*.ingestion_definition.objects[*].schema.connector_options.tiktok_ads_options.lookback_window_days int ALL +resources.pipelines.*.ingestion_definition.objects[*].schema.connector_options.tiktok_ads_options.metrics []string ALL +resources.pipelines.*.ingestion_definition.objects[*].schema.connector_options.tiktok_ads_options.metrics[*] string ALL +resources.pipelines.*.ingestion_definition.objects[*].schema.connector_options.tiktok_ads_options.query_lifetime bool ALL +resources.pipelines.*.ingestion_definition.objects[*].schema.connector_options.tiktok_ads_options.report_type pipelines.TikTokAdsOptionsTikTokReportType ALL +resources.pipelines.*.ingestion_definition.objects[*].schema.connector_options.tiktok_ads_options.sync_start_date string ALL +resources.pipelines.*.ingestion_definition.objects[*].schema.connector_options.zendesk_support_options *pipelines.ZendeskSupportOptions ALL +resources.pipelines.*.ingestion_definition.objects[*].schema.connector_options.zendesk_support_options.start_date string ALL +resources.pipelines.*.ingestion_definition.objects[*].schema.destination_catalog string ALL +resources.pipelines.*.ingestion_definition.objects[*].schema.destination_schema string ALL +resources.pipelines.*.ingestion_definition.objects[*].schema.source_catalog string ALL +resources.pipelines.*.ingestion_definition.objects[*].schema.source_schema string ALL +resources.pipelines.*.ingestion_definition.objects[*].schema.table_configuration *pipelines.TableSpecificConfig ALL +resources.pipelines.*.ingestion_definition.objects[*].schema.table_configuration.auto_full_refresh_policy *pipelines.AutoFullRefreshPolicy ALL +resources.pipelines.*.ingestion_definition.objects[*].schema.table_configuration.auto_full_refresh_policy.enabled bool ALL +resources.pipelines.*.ingestion_definition.objects[*].schema.table_configuration.auto_full_refresh_policy.min_interval_hours int ALL +resources.pipelines.*.ingestion_definition.objects[*].schema.table_configuration.exclude_columns []string ALL +resources.pipelines.*.ingestion_definition.objects[*].schema.table_configuration.exclude_columns[*] string ALL +resources.pipelines.*.ingestion_definition.objects[*].schema.table_configuration.include_columns []string ALL +resources.pipelines.*.ingestion_definition.objects[*].schema.table_configuration.include_columns[*] string ALL +resources.pipelines.*.ingestion_definition.objects[*].schema.table_configuration.primary_keys []string ALL +resources.pipelines.*.ingestion_definition.objects[*].schema.table_configuration.primary_keys[*] string ALL +resources.pipelines.*.ingestion_definition.objects[*].schema.table_configuration.query_based_connector_config *pipelines.IngestionPipelineDefinitionTableSpecificConfigQueryBasedConnectorConfig ALL +resources.pipelines.*.ingestion_definition.objects[*].schema.table_configuration.query_based_connector_config.cursor_columns []string ALL +resources.pipelines.*.ingestion_definition.objects[*].schema.table_configuration.query_based_connector_config.cursor_columns[*] string ALL +resources.pipelines.*.ingestion_definition.objects[*].schema.table_configuration.query_based_connector_config.deletion_condition string ALL +resources.pipelines.*.ingestion_definition.objects[*].schema.table_configuration.query_based_connector_config.hard_deletion_sync_min_interval_in_seconds int64 ALL +resources.pipelines.*.ingestion_definition.objects[*].schema.table_configuration.row_filter string ALL +resources.pipelines.*.ingestion_definition.objects[*].schema.table_configuration.salesforce_include_formula_fields bool ALL +resources.pipelines.*.ingestion_definition.objects[*].schema.table_configuration.scd_type pipelines.TableSpecificConfigScdType ALL +resources.pipelines.*.ingestion_definition.objects[*].schema.table_configuration.sequence_by []string ALL +resources.pipelines.*.ingestion_definition.objects[*].schema.table_configuration.sequence_by[*] string ALL +resources.pipelines.*.ingestion_definition.objects[*].schema.table_configuration.workday_report_parameters *pipelines.IngestionPipelineDefinitionWorkdayReportParameters ALL +resources.pipelines.*.ingestion_definition.objects[*].schema.table_configuration.workday_report_parameters.incremental bool ALL +resources.pipelines.*.ingestion_definition.objects[*].schema.table_configuration.workday_report_parameters.parameters map[string]string ALL +resources.pipelines.*.ingestion_definition.objects[*].schema.table_configuration.workday_report_parameters.parameters.* string ALL +resources.pipelines.*.ingestion_definition.objects[*].schema.table_configuration.workday_report_parameters.report_parameters []pipelines.IngestionPipelineDefinitionWorkdayReportParametersQueryKeyValue ALL +resources.pipelines.*.ingestion_definition.objects[*].schema.table_configuration.workday_report_parameters.report_parameters[*] pipelines.IngestionPipelineDefinitionWorkdayReportParametersQueryKeyValue ALL +resources.pipelines.*.ingestion_definition.objects[*].schema.table_configuration.workday_report_parameters.report_parameters[*].key string ALL +resources.pipelines.*.ingestion_definition.objects[*].schema.table_configuration.workday_report_parameters.report_parameters[*].value string ALL +resources.pipelines.*.ingestion_definition.objects[*].table *pipelines.TableSpec ALL +resources.pipelines.*.ingestion_definition.objects[*].table.connector_options *pipelines.ConnectorOptions ALL +resources.pipelines.*.ingestion_definition.objects[*].table.connector_options.confluence_options *pipelines.ConfluenceConnectorOptions ALL +resources.pipelines.*.ingestion_definition.objects[*].table.connector_options.confluence_options.include_confluence_spaces []string ALL +resources.pipelines.*.ingestion_definition.objects[*].table.connector_options.confluence_options.include_confluence_spaces[*] string ALL +resources.pipelines.*.ingestion_definition.objects[*].table.connector_options.gdrive_options *pipelines.GoogleDriveOptions ALL +resources.pipelines.*.ingestion_definition.objects[*].table.connector_options.gdrive_options.entity_type pipelines.GoogleDriveOptionsGoogleDriveEntityType ALL +resources.pipelines.*.ingestion_definition.objects[*].table.connector_options.gdrive_options.file_ingestion_options *pipelines.FileIngestionOptions ALL +resources.pipelines.*.ingestion_definition.objects[*].table.connector_options.gdrive_options.file_ingestion_options.corrupt_record_column string ALL +resources.pipelines.*.ingestion_definition.objects[*].table.connector_options.gdrive_options.file_ingestion_options.file_filters []pipelines.FileFilter ALL +resources.pipelines.*.ingestion_definition.objects[*].table.connector_options.gdrive_options.file_ingestion_options.file_filters[*] pipelines.FileFilter ALL +resources.pipelines.*.ingestion_definition.objects[*].table.connector_options.gdrive_options.file_ingestion_options.file_filters[*].modified_after string ALL +resources.pipelines.*.ingestion_definition.objects[*].table.connector_options.gdrive_options.file_ingestion_options.file_filters[*].modified_before string ALL +resources.pipelines.*.ingestion_definition.objects[*].table.connector_options.gdrive_options.file_ingestion_options.file_filters[*].path_filter string ALL +resources.pipelines.*.ingestion_definition.objects[*].table.connector_options.gdrive_options.file_ingestion_options.format pipelines.FileIngestionOptionsFileFormat ALL +resources.pipelines.*.ingestion_definition.objects[*].table.connector_options.gdrive_options.file_ingestion_options.format_options map[string]string ALL +resources.pipelines.*.ingestion_definition.objects[*].table.connector_options.gdrive_options.file_ingestion_options.format_options.* string ALL +resources.pipelines.*.ingestion_definition.objects[*].table.connector_options.gdrive_options.file_ingestion_options.ignore_corrupt_files bool ALL +resources.pipelines.*.ingestion_definition.objects[*].table.connector_options.gdrive_options.file_ingestion_options.infer_column_types bool ALL +resources.pipelines.*.ingestion_definition.objects[*].table.connector_options.gdrive_options.file_ingestion_options.reader_case_sensitive bool ALL +resources.pipelines.*.ingestion_definition.objects[*].table.connector_options.gdrive_options.file_ingestion_options.rescued_data_column string ALL +resources.pipelines.*.ingestion_definition.objects[*].table.connector_options.gdrive_options.file_ingestion_options.schema_evolution_mode pipelines.FileIngestionOptionsSchemaEvolutionMode ALL +resources.pipelines.*.ingestion_definition.objects[*].table.connector_options.gdrive_options.file_ingestion_options.schema_hints string ALL +resources.pipelines.*.ingestion_definition.objects[*].table.connector_options.gdrive_options.file_ingestion_options.single_variant_column string ALL +resources.pipelines.*.ingestion_definition.objects[*].table.connector_options.gdrive_options.url string ALL +resources.pipelines.*.ingestion_definition.objects[*].table.connector_options.google_ads_options *pipelines.GoogleAdsOptions ALL +resources.pipelines.*.ingestion_definition.objects[*].table.connector_options.google_ads_options.lookback_window_days int ALL +resources.pipelines.*.ingestion_definition.objects[*].table.connector_options.google_ads_options.manager_account_id string ALL +resources.pipelines.*.ingestion_definition.objects[*].table.connector_options.google_ads_options.sync_start_date string ALL +resources.pipelines.*.ingestion_definition.objects[*].table.connector_options.jira_options *pipelines.JiraConnectorOptions ALL +resources.pipelines.*.ingestion_definition.objects[*].table.connector_options.jira_options.include_jira_spaces []string ALL +resources.pipelines.*.ingestion_definition.objects[*].table.connector_options.jira_options.include_jira_spaces[*] string ALL +resources.pipelines.*.ingestion_definition.objects[*].table.connector_options.kafka_options *pipelines.KafkaOptions ALL +resources.pipelines.*.ingestion_definition.objects[*].table.connector_options.kafka_options.client_config map[string]string ALL +resources.pipelines.*.ingestion_definition.objects[*].table.connector_options.kafka_options.client_config.* string ALL +resources.pipelines.*.ingestion_definition.objects[*].table.connector_options.kafka_options.key_transformer *pipelines.Transformer ALL +resources.pipelines.*.ingestion_definition.objects[*].table.connector_options.kafka_options.key_transformer.format pipelines.TransformerFormat ALL +resources.pipelines.*.ingestion_definition.objects[*].table.connector_options.kafka_options.key_transformer.json_options *pipelines.JsonTransformerOptions ALL +resources.pipelines.*.ingestion_definition.objects[*].table.connector_options.kafka_options.key_transformer.json_options.as_variant bool ALL +resources.pipelines.*.ingestion_definition.objects[*].table.connector_options.kafka_options.key_transformer.json_options.schema string ALL +resources.pipelines.*.ingestion_definition.objects[*].table.connector_options.kafka_options.key_transformer.json_options.schema_evolution_mode pipelines.FileIngestionOptionsSchemaEvolutionMode ALL +resources.pipelines.*.ingestion_definition.objects[*].table.connector_options.kafka_options.key_transformer.json_options.schema_file_path string ALL +resources.pipelines.*.ingestion_definition.objects[*].table.connector_options.kafka_options.key_transformer.json_options.schema_hints string ALL +resources.pipelines.*.ingestion_definition.objects[*].table.connector_options.kafka_options.max_offsets_per_trigger int64 ALL +resources.pipelines.*.ingestion_definition.objects[*].table.connector_options.kafka_options.starting_offset string ALL +resources.pipelines.*.ingestion_definition.objects[*].table.connector_options.kafka_options.topic_pattern string ALL +resources.pipelines.*.ingestion_definition.objects[*].table.connector_options.kafka_options.topics []string ALL +resources.pipelines.*.ingestion_definition.objects[*].table.connector_options.kafka_options.topics[*] string ALL +resources.pipelines.*.ingestion_definition.objects[*].table.connector_options.kafka_options.value_transformer *pipelines.Transformer ALL +resources.pipelines.*.ingestion_definition.objects[*].table.connector_options.kafka_options.value_transformer.format pipelines.TransformerFormat ALL +resources.pipelines.*.ingestion_definition.objects[*].table.connector_options.kafka_options.value_transformer.json_options *pipelines.JsonTransformerOptions ALL +resources.pipelines.*.ingestion_definition.objects[*].table.connector_options.kafka_options.value_transformer.json_options.as_variant bool ALL +resources.pipelines.*.ingestion_definition.objects[*].table.connector_options.kafka_options.value_transformer.json_options.schema string ALL +resources.pipelines.*.ingestion_definition.objects[*].table.connector_options.kafka_options.value_transformer.json_options.schema_evolution_mode pipelines.FileIngestionOptionsSchemaEvolutionMode ALL +resources.pipelines.*.ingestion_definition.objects[*].table.connector_options.kafka_options.value_transformer.json_options.schema_file_path string ALL +resources.pipelines.*.ingestion_definition.objects[*].table.connector_options.kafka_options.value_transformer.json_options.schema_hints string ALL +resources.pipelines.*.ingestion_definition.objects[*].table.connector_options.meta_ads_options *pipelines.MetaMarketingOptions ALL +resources.pipelines.*.ingestion_definition.objects[*].table.connector_options.meta_ads_options.action_attribution_windows []string ALL +resources.pipelines.*.ingestion_definition.objects[*].table.connector_options.meta_ads_options.action_attribution_windows[*] string ALL +resources.pipelines.*.ingestion_definition.objects[*].table.connector_options.meta_ads_options.action_breakdowns []string ALL +resources.pipelines.*.ingestion_definition.objects[*].table.connector_options.meta_ads_options.action_breakdowns[*] string ALL +resources.pipelines.*.ingestion_definition.objects[*].table.connector_options.meta_ads_options.action_report_time string ALL +resources.pipelines.*.ingestion_definition.objects[*].table.connector_options.meta_ads_options.breakdowns []string ALL +resources.pipelines.*.ingestion_definition.objects[*].table.connector_options.meta_ads_options.breakdowns[*] string ALL +resources.pipelines.*.ingestion_definition.objects[*].table.connector_options.meta_ads_options.custom_insights_lookback_window int ALL +resources.pipelines.*.ingestion_definition.objects[*].table.connector_options.meta_ads_options.level string ALL +resources.pipelines.*.ingestion_definition.objects[*].table.connector_options.meta_ads_options.start_date string ALL +resources.pipelines.*.ingestion_definition.objects[*].table.connector_options.meta_ads_options.time_increment string ALL +resources.pipelines.*.ingestion_definition.objects[*].table.connector_options.outlook_options *pipelines.OutlookOptions ALL +resources.pipelines.*.ingestion_definition.objects[*].table.connector_options.outlook_options.attachment_mode pipelines.OutlookAttachmentMode ALL +resources.pipelines.*.ingestion_definition.objects[*].table.connector_options.outlook_options.body_format pipelines.OutlookBodyFormat ALL +resources.pipelines.*.ingestion_definition.objects[*].table.connector_options.outlook_options.folder_filter []string ALL +resources.pipelines.*.ingestion_definition.objects[*].table.connector_options.outlook_options.folder_filter[*] string ALL +resources.pipelines.*.ingestion_definition.objects[*].table.connector_options.outlook_options.include_folders []string ALL +resources.pipelines.*.ingestion_definition.objects[*].table.connector_options.outlook_options.include_folders[*] string ALL +resources.pipelines.*.ingestion_definition.objects[*].table.connector_options.outlook_options.include_mailboxes []string ALL +resources.pipelines.*.ingestion_definition.objects[*].table.connector_options.outlook_options.include_mailboxes[*] string ALL +resources.pipelines.*.ingestion_definition.objects[*].table.connector_options.outlook_options.include_senders []string ALL +resources.pipelines.*.ingestion_definition.objects[*].table.connector_options.outlook_options.include_senders[*] string ALL +resources.pipelines.*.ingestion_definition.objects[*].table.connector_options.outlook_options.include_subjects []string ALL +resources.pipelines.*.ingestion_definition.objects[*].table.connector_options.outlook_options.include_subjects[*] string ALL +resources.pipelines.*.ingestion_definition.objects[*].table.connector_options.outlook_options.sender_filter []string ALL +resources.pipelines.*.ingestion_definition.objects[*].table.connector_options.outlook_options.sender_filter[*] string ALL +resources.pipelines.*.ingestion_definition.objects[*].table.connector_options.outlook_options.start_date string ALL +resources.pipelines.*.ingestion_definition.objects[*].table.connector_options.outlook_options.subject_filter []string ALL +resources.pipelines.*.ingestion_definition.objects[*].table.connector_options.outlook_options.subject_filter[*] string ALL +resources.pipelines.*.ingestion_definition.objects[*].table.connector_options.sharepoint_options *pipelines.SharepointOptions ALL +resources.pipelines.*.ingestion_definition.objects[*].table.connector_options.sharepoint_options.entity_type pipelines.SharepointOptionsSharepointEntityType ALL +resources.pipelines.*.ingestion_definition.objects[*].table.connector_options.sharepoint_options.file_ingestion_options *pipelines.FileIngestionOptions ALL +resources.pipelines.*.ingestion_definition.objects[*].table.connector_options.sharepoint_options.file_ingestion_options.corrupt_record_column string ALL +resources.pipelines.*.ingestion_definition.objects[*].table.connector_options.sharepoint_options.file_ingestion_options.file_filters []pipelines.FileFilter ALL +resources.pipelines.*.ingestion_definition.objects[*].table.connector_options.sharepoint_options.file_ingestion_options.file_filters[*] pipelines.FileFilter ALL +resources.pipelines.*.ingestion_definition.objects[*].table.connector_options.sharepoint_options.file_ingestion_options.file_filters[*].modified_after string ALL +resources.pipelines.*.ingestion_definition.objects[*].table.connector_options.sharepoint_options.file_ingestion_options.file_filters[*].modified_before string ALL +resources.pipelines.*.ingestion_definition.objects[*].table.connector_options.sharepoint_options.file_ingestion_options.file_filters[*].path_filter string ALL +resources.pipelines.*.ingestion_definition.objects[*].table.connector_options.sharepoint_options.file_ingestion_options.format pipelines.FileIngestionOptionsFileFormat ALL +resources.pipelines.*.ingestion_definition.objects[*].table.connector_options.sharepoint_options.file_ingestion_options.format_options map[string]string ALL +resources.pipelines.*.ingestion_definition.objects[*].table.connector_options.sharepoint_options.file_ingestion_options.format_options.* string ALL +resources.pipelines.*.ingestion_definition.objects[*].table.connector_options.sharepoint_options.file_ingestion_options.ignore_corrupt_files bool ALL +resources.pipelines.*.ingestion_definition.objects[*].table.connector_options.sharepoint_options.file_ingestion_options.infer_column_types bool ALL +resources.pipelines.*.ingestion_definition.objects[*].table.connector_options.sharepoint_options.file_ingestion_options.reader_case_sensitive bool ALL +resources.pipelines.*.ingestion_definition.objects[*].table.connector_options.sharepoint_options.file_ingestion_options.rescued_data_column string ALL +resources.pipelines.*.ingestion_definition.objects[*].table.connector_options.sharepoint_options.file_ingestion_options.schema_evolution_mode pipelines.FileIngestionOptionsSchemaEvolutionMode ALL +resources.pipelines.*.ingestion_definition.objects[*].table.connector_options.sharepoint_options.file_ingestion_options.schema_hints string ALL +resources.pipelines.*.ingestion_definition.objects[*].table.connector_options.sharepoint_options.file_ingestion_options.single_variant_column string ALL +resources.pipelines.*.ingestion_definition.objects[*].table.connector_options.sharepoint_options.url string ALL +resources.pipelines.*.ingestion_definition.objects[*].table.connector_options.smartsheet_options *pipelines.SmartsheetOptions ALL +resources.pipelines.*.ingestion_definition.objects[*].table.connector_options.smartsheet_options.enforce_schema bool ALL +resources.pipelines.*.ingestion_definition.objects[*].table.connector_options.tiktok_ads_options *pipelines.TikTokAdsOptions ALL +resources.pipelines.*.ingestion_definition.objects[*].table.connector_options.tiktok_ads_options.data_level pipelines.TikTokAdsOptionsTikTokDataLevel ALL +resources.pipelines.*.ingestion_definition.objects[*].table.connector_options.tiktok_ads_options.dimensions []string ALL +resources.pipelines.*.ingestion_definition.objects[*].table.connector_options.tiktok_ads_options.dimensions[*] string ALL +resources.pipelines.*.ingestion_definition.objects[*].table.connector_options.tiktok_ads_options.lookback_window_days int ALL +resources.pipelines.*.ingestion_definition.objects[*].table.connector_options.tiktok_ads_options.metrics []string ALL +resources.pipelines.*.ingestion_definition.objects[*].table.connector_options.tiktok_ads_options.metrics[*] string ALL +resources.pipelines.*.ingestion_definition.objects[*].table.connector_options.tiktok_ads_options.query_lifetime bool ALL +resources.pipelines.*.ingestion_definition.objects[*].table.connector_options.tiktok_ads_options.report_type pipelines.TikTokAdsOptionsTikTokReportType ALL +resources.pipelines.*.ingestion_definition.objects[*].table.connector_options.tiktok_ads_options.sync_start_date string ALL +resources.pipelines.*.ingestion_definition.objects[*].table.connector_options.zendesk_support_options *pipelines.ZendeskSupportOptions ALL +resources.pipelines.*.ingestion_definition.objects[*].table.connector_options.zendesk_support_options.start_date string ALL +resources.pipelines.*.ingestion_definition.objects[*].table.destination_catalog string ALL +resources.pipelines.*.ingestion_definition.objects[*].table.destination_schema string ALL +resources.pipelines.*.ingestion_definition.objects[*].table.destination_table string ALL +resources.pipelines.*.ingestion_definition.objects[*].table.source_catalog string ALL +resources.pipelines.*.ingestion_definition.objects[*].table.source_schema string ALL +resources.pipelines.*.ingestion_definition.objects[*].table.source_table string ALL +resources.pipelines.*.ingestion_definition.objects[*].table.table_configuration *pipelines.TableSpecificConfig ALL +resources.pipelines.*.ingestion_definition.objects[*].table.table_configuration.auto_full_refresh_policy *pipelines.AutoFullRefreshPolicy ALL +resources.pipelines.*.ingestion_definition.objects[*].table.table_configuration.auto_full_refresh_policy.enabled bool ALL +resources.pipelines.*.ingestion_definition.objects[*].table.table_configuration.auto_full_refresh_policy.min_interval_hours int ALL +resources.pipelines.*.ingestion_definition.objects[*].table.table_configuration.exclude_columns []string ALL +resources.pipelines.*.ingestion_definition.objects[*].table.table_configuration.exclude_columns[*] string ALL +resources.pipelines.*.ingestion_definition.objects[*].table.table_configuration.include_columns []string ALL +resources.pipelines.*.ingestion_definition.objects[*].table.table_configuration.include_columns[*] string ALL +resources.pipelines.*.ingestion_definition.objects[*].table.table_configuration.primary_keys []string ALL +resources.pipelines.*.ingestion_definition.objects[*].table.table_configuration.primary_keys[*] string ALL +resources.pipelines.*.ingestion_definition.objects[*].table.table_configuration.query_based_connector_config *pipelines.IngestionPipelineDefinitionTableSpecificConfigQueryBasedConnectorConfig ALL +resources.pipelines.*.ingestion_definition.objects[*].table.table_configuration.query_based_connector_config.cursor_columns []string ALL +resources.pipelines.*.ingestion_definition.objects[*].table.table_configuration.query_based_connector_config.cursor_columns[*] string ALL +resources.pipelines.*.ingestion_definition.objects[*].table.table_configuration.query_based_connector_config.deletion_condition string ALL +resources.pipelines.*.ingestion_definition.objects[*].table.table_configuration.query_based_connector_config.hard_deletion_sync_min_interval_in_seconds int64 ALL +resources.pipelines.*.ingestion_definition.objects[*].table.table_configuration.row_filter string ALL +resources.pipelines.*.ingestion_definition.objects[*].table.table_configuration.salesforce_include_formula_fields bool ALL +resources.pipelines.*.ingestion_definition.objects[*].table.table_configuration.scd_type pipelines.TableSpecificConfigScdType ALL +resources.pipelines.*.ingestion_definition.objects[*].table.table_configuration.sequence_by []string ALL +resources.pipelines.*.ingestion_definition.objects[*].table.table_configuration.sequence_by[*] string ALL +resources.pipelines.*.ingestion_definition.objects[*].table.table_configuration.workday_report_parameters *pipelines.IngestionPipelineDefinitionWorkdayReportParameters ALL +resources.pipelines.*.ingestion_definition.objects[*].table.table_configuration.workday_report_parameters.incremental bool ALL +resources.pipelines.*.ingestion_definition.objects[*].table.table_configuration.workday_report_parameters.parameters map[string]string ALL +resources.pipelines.*.ingestion_definition.objects[*].table.table_configuration.workday_report_parameters.parameters.* string ALL +resources.pipelines.*.ingestion_definition.objects[*].table.table_configuration.workday_report_parameters.report_parameters []pipelines.IngestionPipelineDefinitionWorkdayReportParametersQueryKeyValue ALL +resources.pipelines.*.ingestion_definition.objects[*].table.table_configuration.workday_report_parameters.report_parameters[*] pipelines.IngestionPipelineDefinitionWorkdayReportParametersQueryKeyValue ALL +resources.pipelines.*.ingestion_definition.objects[*].table.table_configuration.workday_report_parameters.report_parameters[*].key string ALL +resources.pipelines.*.ingestion_definition.objects[*].table.table_configuration.workday_report_parameters.report_parameters[*].value string ALL +resources.pipelines.*.ingestion_definition.source_configurations []pipelines.SourceConfig ALL +resources.pipelines.*.ingestion_definition.source_configurations[*] pipelines.SourceConfig ALL +resources.pipelines.*.ingestion_definition.source_configurations[*].catalog *pipelines.SourceCatalogConfig ALL +resources.pipelines.*.ingestion_definition.source_configurations[*].catalog.postgres *pipelines.PostgresCatalogConfig ALL +resources.pipelines.*.ingestion_definition.source_configurations[*].catalog.postgres.slot_config *pipelines.PostgresSlotConfig ALL +resources.pipelines.*.ingestion_definition.source_configurations[*].catalog.postgres.slot_config.publication_name string ALL +resources.pipelines.*.ingestion_definition.source_configurations[*].catalog.postgres.slot_config.slot_name string ALL +resources.pipelines.*.ingestion_definition.source_configurations[*].catalog.source_catalog string ALL +resources.pipelines.*.ingestion_definition.source_configurations[*].google_ads_config *pipelines.GoogleAdsConfig ALL +resources.pipelines.*.ingestion_definition.source_configurations[*].google_ads_config.manager_account_id string ALL +resources.pipelines.*.ingestion_definition.source_type pipelines.IngestionSourceType ALL +resources.pipelines.*.ingestion_definition.table_configuration *pipelines.TableSpecificConfig ALL +resources.pipelines.*.ingestion_definition.table_configuration.auto_full_refresh_policy *pipelines.AutoFullRefreshPolicy ALL +resources.pipelines.*.ingestion_definition.table_configuration.auto_full_refresh_policy.enabled bool ALL +resources.pipelines.*.ingestion_definition.table_configuration.auto_full_refresh_policy.min_interval_hours int ALL +resources.pipelines.*.ingestion_definition.table_configuration.exclude_columns []string ALL +resources.pipelines.*.ingestion_definition.table_configuration.exclude_columns[*] string ALL +resources.pipelines.*.ingestion_definition.table_configuration.include_columns []string ALL +resources.pipelines.*.ingestion_definition.table_configuration.include_columns[*] string ALL +resources.pipelines.*.ingestion_definition.table_configuration.primary_keys []string ALL +resources.pipelines.*.ingestion_definition.table_configuration.primary_keys[*] string ALL +resources.pipelines.*.ingestion_definition.table_configuration.query_based_connector_config *pipelines.IngestionPipelineDefinitionTableSpecificConfigQueryBasedConnectorConfig ALL +resources.pipelines.*.ingestion_definition.table_configuration.query_based_connector_config.cursor_columns []string ALL +resources.pipelines.*.ingestion_definition.table_configuration.query_based_connector_config.cursor_columns[*] string ALL +resources.pipelines.*.ingestion_definition.table_configuration.query_based_connector_config.deletion_condition string ALL +resources.pipelines.*.ingestion_definition.table_configuration.query_based_connector_config.hard_deletion_sync_min_interval_in_seconds int64 ALL +resources.pipelines.*.ingestion_definition.table_configuration.row_filter string ALL +resources.pipelines.*.ingestion_definition.table_configuration.salesforce_include_formula_fields bool ALL +resources.pipelines.*.ingestion_definition.table_configuration.scd_type pipelines.TableSpecificConfigScdType ALL +resources.pipelines.*.ingestion_definition.table_configuration.sequence_by []string ALL +resources.pipelines.*.ingestion_definition.table_configuration.sequence_by[*] string ALL +resources.pipelines.*.ingestion_definition.table_configuration.workday_report_parameters *pipelines.IngestionPipelineDefinitionWorkdayReportParameters ALL +resources.pipelines.*.ingestion_definition.table_configuration.workday_report_parameters.incremental bool ALL +resources.pipelines.*.ingestion_definition.table_configuration.workday_report_parameters.parameters map[string]string ALL +resources.pipelines.*.ingestion_definition.table_configuration.workday_report_parameters.parameters.* string ALL +resources.pipelines.*.ingestion_definition.table_configuration.workday_report_parameters.report_parameters []pipelines.IngestionPipelineDefinitionWorkdayReportParametersQueryKeyValue ALL +resources.pipelines.*.ingestion_definition.table_configuration.workday_report_parameters.report_parameters[*] pipelines.IngestionPipelineDefinitionWorkdayReportParametersQueryKeyValue ALL +resources.pipelines.*.ingestion_definition.table_configuration.workday_report_parameters.report_parameters[*].key string ALL +resources.pipelines.*.ingestion_definition.table_configuration.workday_report_parameters.report_parameters[*].value string ALL +resources.pipelines.*.last_modified int64 REMOTE +resources.pipelines.*.latest_updates []pipelines.UpdateStateInfo REMOTE +resources.pipelines.*.latest_updates[*] pipelines.UpdateStateInfo REMOTE +resources.pipelines.*.latest_updates[*].creation_time string REMOTE +resources.pipelines.*.latest_updates[*].state pipelines.UpdateStateInfoState REMOTE +resources.pipelines.*.latest_updates[*].update_id string REMOTE +resources.pipelines.*.libraries []pipelines.PipelineLibrary ALL +resources.pipelines.*.libraries[*] pipelines.PipelineLibrary ALL +resources.pipelines.*.libraries[*].file *pipelines.FileLibrary ALL +resources.pipelines.*.libraries[*].file.path string ALL +resources.pipelines.*.libraries[*].glob *pipelines.PathPattern ALL +resources.pipelines.*.libraries[*].glob.include string ALL +resources.pipelines.*.libraries[*].jar string ALL +resources.pipelines.*.libraries[*].maven *compute.MavenLibrary ALL +resources.pipelines.*.libraries[*].maven.coordinates string ALL +resources.pipelines.*.libraries[*].maven.exclusions []string ALL +resources.pipelines.*.libraries[*].maven.exclusions[*] string ALL +resources.pipelines.*.libraries[*].maven.repo string ALL +resources.pipelines.*.libraries[*].notebook *pipelines.NotebookLibrary ALL +resources.pipelines.*.libraries[*].notebook.path string ALL +resources.pipelines.*.libraries[*].whl string ALL +resources.pipelines.*.lifecycle resources.Lifecycle INPUT +resources.pipelines.*.lifecycle.prevent_destroy bool INPUT +resources.pipelines.*.modified_status string INPUT +resources.pipelines.*.name string ALL +resources.pipelines.*.notifications []pipelines.Notifications ALL +resources.pipelines.*.notifications[*] pipelines.Notifications ALL +resources.pipelines.*.notifications[*].alerts []string ALL +resources.pipelines.*.notifications[*].alerts[*] string ALL +resources.pipelines.*.notifications[*].email_recipients []string ALL +resources.pipelines.*.notifications[*].email_recipients[*] string ALL +resources.pipelines.*.photon bool ALL +resources.pipelines.*.pipeline_id string REMOTE +resources.pipelines.*.restart_window *pipelines.RestartWindow ALL +resources.pipelines.*.restart_window.days_of_week []pipelines.DayOfWeek ALL +resources.pipelines.*.restart_window.days_of_week[*] pipelines.DayOfWeek ALL +resources.pipelines.*.restart_window.start_hour int ALL +resources.pipelines.*.restart_window.time_zone_id string ALL +resources.pipelines.*.root_path string ALL +resources.pipelines.*.run_as *pipelines.RunAs ALL +resources.pipelines.*.run_as.service_principal_name string ALL +resources.pipelines.*.run_as.user_name string ALL +resources.pipelines.*.run_as_user_name string REMOTE +resources.pipelines.*.schema string ALL +resources.pipelines.*.serverless bool ALL +resources.pipelines.*.state pipelines.PipelineState REMOTE +resources.pipelines.*.storage string ALL +resources.pipelines.*.tags map[string]string ALL +resources.pipelines.*.tags.* string ALL +resources.pipelines.*.target string ALL +resources.pipelines.*.trigger *pipelines.PipelineTrigger ALL +resources.pipelines.*.trigger.cron *pipelines.CronTrigger ALL +resources.pipelines.*.trigger.cron.quartz_cron_schedule string ALL +resources.pipelines.*.trigger.cron.timezone_id string ALL +resources.pipelines.*.trigger.manual *pipelines.ManualTrigger ALL +resources.pipelines.*.url string INPUT +resources.pipelines.*.usage_policy_id string ALL +resources.pipelines.*.permissions.object_id string ALL +resources.pipelines.*.permissions[*] dresources.StatePermission ALL +resources.pipelines.*.permissions[*].group_name string ALL +resources.pipelines.*.permissions[*].level iam.PermissionLevel ALL +resources.pipelines.*.permissions[*].service_principal_name string ALL +resources.pipelines.*.permissions[*].user_name string ALL +resources.postgres_branches.*.branch_id string ALL +resources.postgres_branches.*.create_time *time.Time REMOTE +resources.postgres_branches.*.expire_time *time.Time ALL +resources.postgres_branches.*.id string INPUT +resources.postgres_branches.*.is_protected bool ALL +resources.postgres_branches.*.lifecycle resources.Lifecycle INPUT +resources.postgres_branches.*.lifecycle.prevent_destroy bool INPUT +resources.postgres_branches.*.modified_status string INPUT +resources.postgres_branches.*.name string REMOTE +resources.postgres_branches.*.no_expiry bool ALL +resources.postgres_branches.*.parent string ALL +resources.postgres_branches.*.replace_existing bool INPUT STATE +resources.postgres_branches.*.source_branch string ALL +resources.postgres_branches.*.source_branch_lsn string ALL +resources.postgres_branches.*.source_branch_time *time.Time ALL +resources.postgres_branches.*.status *postgres.BranchStatus REMOTE +resources.postgres_branches.*.status.branch_id string REMOTE +resources.postgres_branches.*.status.current_state postgres.BranchStatusState REMOTE +resources.postgres_branches.*.status.default bool REMOTE +resources.postgres_branches.*.status.delete_time *time.Time REMOTE +resources.postgres_branches.*.status.expire_time *time.Time REMOTE +resources.postgres_branches.*.status.is_protected bool REMOTE +resources.postgres_branches.*.status.logical_size_bytes int64 REMOTE +resources.postgres_branches.*.status.pending_state postgres.BranchStatusState REMOTE +resources.postgres_branches.*.status.purge_time *time.Time REMOTE +resources.postgres_branches.*.status.source_branch string REMOTE +resources.postgres_branches.*.status.source_branch_lsn string REMOTE +resources.postgres_branches.*.status.source_branch_time *time.Time REMOTE +resources.postgres_branches.*.status.state_change_time *time.Time REMOTE +resources.postgres_branches.*.ttl *duration.Duration ALL +resources.postgres_branches.*.uid string REMOTE +resources.postgres_branches.*.update_time *time.Time REMOTE +resources.postgres_branches.*.url string INPUT +resources.postgres_catalogs.*.branch string ALL +resources.postgres_catalogs.*.catalog_id string ALL +resources.postgres_catalogs.*.create_database_if_missing bool ALL +resources.postgres_catalogs.*.create_time *time.Time REMOTE +resources.postgres_catalogs.*.id string INPUT +resources.postgres_catalogs.*.lifecycle resources.Lifecycle INPUT +resources.postgres_catalogs.*.lifecycle.prevent_destroy bool INPUT +resources.postgres_catalogs.*.modified_status string INPUT +resources.postgres_catalogs.*.name string REMOTE +resources.postgres_catalogs.*.postgres_database string ALL +resources.postgres_catalogs.*.status *postgres.CatalogCatalogStatus REMOTE +resources.postgres_catalogs.*.status.branch string REMOTE +resources.postgres_catalogs.*.status.catalog_id string REMOTE +resources.postgres_catalogs.*.status.postgres_database string REMOTE +resources.postgres_catalogs.*.status.project string REMOTE +resources.postgres_catalogs.*.uid string REMOTE +resources.postgres_catalogs.*.update_time *time.Time REMOTE +resources.postgres_catalogs.*.url string INPUT +resources.postgres_endpoints.*.autoscaling_limit_max_cu float64 ALL +resources.postgres_endpoints.*.autoscaling_limit_min_cu float64 ALL +resources.postgres_endpoints.*.create_time *time.Time REMOTE +resources.postgres_endpoints.*.disabled bool ALL +resources.postgres_endpoints.*.endpoint_id string ALL +resources.postgres_endpoints.*.endpoint_type postgres.EndpointType ALL +resources.postgres_endpoints.*.group *postgres.EndpointGroupSpec ALL +resources.postgres_endpoints.*.group.enable_readable_secondaries bool ALL +resources.postgres_endpoints.*.group.max int ALL +resources.postgres_endpoints.*.group.min int ALL +resources.postgres_endpoints.*.id string INPUT +resources.postgres_endpoints.*.lifecycle resources.Lifecycle INPUT +resources.postgres_endpoints.*.lifecycle.prevent_destroy bool INPUT +resources.postgres_endpoints.*.modified_status string INPUT +resources.postgres_endpoints.*.name string REMOTE +resources.postgres_endpoints.*.no_suspension bool ALL +resources.postgres_endpoints.*.parent string ALL +resources.postgres_endpoints.*.replace_existing bool INPUT STATE +resources.postgres_endpoints.*.settings *postgres.EndpointSettings ALL +resources.postgres_endpoints.*.settings.pg_settings map[string]string ALL +resources.postgres_endpoints.*.settings.pg_settings.* string ALL +resources.postgres_endpoints.*.status *postgres.EndpointStatus REMOTE +resources.postgres_endpoints.*.status.autoscaling_limit_max_cu float64 REMOTE +resources.postgres_endpoints.*.status.autoscaling_limit_min_cu float64 REMOTE +resources.postgres_endpoints.*.status.current_state postgres.EndpointStatusState REMOTE +resources.postgres_endpoints.*.status.disabled bool REMOTE +resources.postgres_endpoints.*.status.endpoint_id string REMOTE +resources.postgres_endpoints.*.status.endpoint_type postgres.EndpointType REMOTE +resources.postgres_endpoints.*.status.group *postgres.EndpointGroupStatus REMOTE +resources.postgres_endpoints.*.status.group.enable_readable_secondaries bool REMOTE +resources.postgres_endpoints.*.status.group.max int REMOTE +resources.postgres_endpoints.*.status.group.min int REMOTE +resources.postgres_endpoints.*.status.hosts *postgres.EndpointHosts REMOTE +resources.postgres_endpoints.*.status.hosts.host string REMOTE +resources.postgres_endpoints.*.status.hosts.read_only_host string REMOTE +resources.postgres_endpoints.*.status.pending_state postgres.EndpointStatusState REMOTE +resources.postgres_endpoints.*.status.settings *postgres.EndpointSettings REMOTE +resources.postgres_endpoints.*.status.settings.pg_settings map[string]string REMOTE +resources.postgres_endpoints.*.status.settings.pg_settings.* string REMOTE +resources.postgres_endpoints.*.status.suspend_timeout_duration *duration.Duration REMOTE +resources.postgres_endpoints.*.suspend_timeout_duration *duration.Duration ALL +resources.postgres_endpoints.*.uid string REMOTE +resources.postgres_endpoints.*.update_time *time.Time REMOTE +resources.postgres_endpoints.*.url string INPUT +resources.postgres_projects.*.budget_policy_id string ALL +resources.postgres_projects.*.create_time *time.Time REMOTE +resources.postgres_projects.*.custom_tags []postgres.ProjectCustomTag ALL +resources.postgres_projects.*.custom_tags[*] postgres.ProjectCustomTag ALL +resources.postgres_projects.*.custom_tags[*].key string ALL +resources.postgres_projects.*.custom_tags[*].value string ALL +resources.postgres_projects.*.default_branch string ALL +resources.postgres_projects.*.default_endpoint_settings *postgres.ProjectDefaultEndpointSettings ALL +resources.postgres_projects.*.default_endpoint_settings.autoscaling_limit_max_cu float64 ALL +resources.postgres_projects.*.default_endpoint_settings.autoscaling_limit_min_cu float64 ALL +resources.postgres_projects.*.default_endpoint_settings.no_suspension bool ALL +resources.postgres_projects.*.default_endpoint_settings.pg_settings map[string]string ALL +resources.postgres_projects.*.default_endpoint_settings.pg_settings.* string ALL +resources.postgres_projects.*.default_endpoint_settings.suspend_timeout_duration *duration.Duration ALL +resources.postgres_projects.*.delete_time *time.Time REMOTE +resources.postgres_projects.*.display_name string ALL +resources.postgres_projects.*.enable_pg_native_login bool ALL +resources.postgres_projects.*.history_retention_duration *duration.Duration ALL +resources.postgres_projects.*.id string INPUT +resources.postgres_projects.*.initial_endpoint_spec *postgres.InitialEndpointSpec REMOTE +resources.postgres_projects.*.initial_endpoint_spec.group *postgres.EndpointGroupSpec REMOTE +resources.postgres_projects.*.initial_endpoint_spec.group.enable_readable_secondaries bool REMOTE +resources.postgres_projects.*.initial_endpoint_spec.group.max int REMOTE +resources.postgres_projects.*.initial_endpoint_spec.group.min int REMOTE +resources.postgres_projects.*.lifecycle resources.Lifecycle INPUT +resources.postgres_projects.*.lifecycle.prevent_destroy bool INPUT +resources.postgres_projects.*.modified_status string INPUT +resources.postgres_projects.*.name string REMOTE +resources.postgres_projects.*.pg_version int ALL +resources.postgres_projects.*.project_id string ALL +resources.postgres_projects.*.purge_time *time.Time REMOTE +resources.postgres_projects.*.status *postgres.ProjectStatus REMOTE +resources.postgres_projects.*.status.branch_logical_size_limit_bytes int64 REMOTE +resources.postgres_projects.*.status.budget_policy_id string REMOTE +resources.postgres_projects.*.status.custom_tags []postgres.ProjectCustomTag REMOTE +resources.postgres_projects.*.status.custom_tags[*] postgres.ProjectCustomTag REMOTE +resources.postgres_projects.*.status.custom_tags[*].key string REMOTE +resources.postgres_projects.*.status.custom_tags[*].value string REMOTE +resources.postgres_projects.*.status.default_branch string REMOTE +resources.postgres_projects.*.status.default_endpoint_settings *postgres.ProjectDefaultEndpointSettings REMOTE +resources.postgres_projects.*.status.default_endpoint_settings.autoscaling_limit_max_cu float64 REMOTE +resources.postgres_projects.*.status.default_endpoint_settings.autoscaling_limit_min_cu float64 REMOTE +resources.postgres_projects.*.status.default_endpoint_settings.no_suspension bool REMOTE +resources.postgres_projects.*.status.default_endpoint_settings.pg_settings map[string]string REMOTE +resources.postgres_projects.*.status.default_endpoint_settings.pg_settings.* string REMOTE +resources.postgres_projects.*.status.default_endpoint_settings.suspend_timeout_duration *duration.Duration REMOTE +resources.postgres_projects.*.status.display_name string REMOTE +resources.postgres_projects.*.status.enable_pg_native_login bool REMOTE +resources.postgres_projects.*.status.history_retention_duration *duration.Duration REMOTE +resources.postgres_projects.*.status.owner string REMOTE +resources.postgres_projects.*.status.pg_version int REMOTE +resources.postgres_projects.*.status.project_id string REMOTE +resources.postgres_projects.*.status.synthetic_storage_size_bytes int64 REMOTE +resources.postgres_projects.*.uid string REMOTE +resources.postgres_projects.*.update_time *time.Time REMOTE +resources.postgres_projects.*.url string INPUT +resources.postgres_projects.*.permissions.object_id string ALL +resources.postgres_projects.*.permissions[*] dresources.StatePermission ALL +resources.postgres_projects.*.permissions[*].group_name string ALL +resources.postgres_projects.*.permissions[*].level iam.PermissionLevel ALL +resources.postgres_projects.*.permissions[*].service_principal_name string ALL +resources.postgres_projects.*.permissions[*].user_name string ALL +resources.postgres_synced_tables.*.branch string ALL +resources.postgres_synced_tables.*.create_database_objects_if_missing bool ALL +resources.postgres_synced_tables.*.create_time *time.Time REMOTE +resources.postgres_synced_tables.*.existing_pipeline_id string ALL +resources.postgres_synced_tables.*.id string INPUT +resources.postgres_synced_tables.*.lifecycle resources.Lifecycle INPUT +resources.postgres_synced_tables.*.lifecycle.prevent_destroy bool INPUT +resources.postgres_synced_tables.*.modified_status string INPUT +resources.postgres_synced_tables.*.name string REMOTE +resources.postgres_synced_tables.*.new_pipeline_spec *postgres.NewPipelineSpec ALL +resources.postgres_synced_tables.*.new_pipeline_spec.budget_policy_id string ALL +resources.postgres_synced_tables.*.new_pipeline_spec.storage_catalog string ALL +resources.postgres_synced_tables.*.new_pipeline_spec.storage_schema string ALL +resources.postgres_synced_tables.*.postgres_database string ALL +resources.postgres_synced_tables.*.primary_key_columns []string ALL +resources.postgres_synced_tables.*.primary_key_columns[*] string ALL +resources.postgres_synced_tables.*.scheduling_policy postgres.SyncedTableSyncedTableSpecSyncedTableSchedulingPolicy ALL +resources.postgres_synced_tables.*.source_table_full_name string ALL +resources.postgres_synced_tables.*.status *postgres.SyncedTableSyncedTableStatus REMOTE +resources.postgres_synced_tables.*.status.detailed_state postgres.SyncedTableState REMOTE +resources.postgres_synced_tables.*.status.last_processed_commit_version int64 REMOTE +resources.postgres_synced_tables.*.status.last_sync *postgres.SyncedTablePosition REMOTE +resources.postgres_synced_tables.*.status.last_sync.delta_table_sync_info *postgres.DeltaTableSyncInfo REMOTE +resources.postgres_synced_tables.*.status.last_sync.delta_table_sync_info.delta_commit_time *time.Time REMOTE +resources.postgres_synced_tables.*.status.last_sync.delta_table_sync_info.delta_commit_version int64 REMOTE +resources.postgres_synced_tables.*.status.last_sync.sync_end_time *time.Time REMOTE +resources.postgres_synced_tables.*.status.last_sync.sync_start_time *time.Time REMOTE +resources.postgres_synced_tables.*.status.last_sync_time *time.Time REMOTE +resources.postgres_synced_tables.*.status.message string REMOTE +resources.postgres_synced_tables.*.status.ongoing_sync_progress *postgres.SyncedTablePipelineProgress REMOTE +resources.postgres_synced_tables.*.status.ongoing_sync_progress.estimated_completion_time_seconds float64 REMOTE +resources.postgres_synced_tables.*.status.ongoing_sync_progress.latest_version_currently_processing int64 REMOTE +resources.postgres_synced_tables.*.status.ongoing_sync_progress.sync_progress_completion float64 REMOTE +resources.postgres_synced_tables.*.status.ongoing_sync_progress.synced_row_count int64 REMOTE +resources.postgres_synced_tables.*.status.ongoing_sync_progress.total_row_count int64 REMOTE +resources.postgres_synced_tables.*.status.pipeline_id string REMOTE +resources.postgres_synced_tables.*.status.project string REMOTE +resources.postgres_synced_tables.*.status.provisioning_phase postgres.ProvisioningPhase REMOTE +resources.postgres_synced_tables.*.status.unity_catalog_provisioning_state postgres.ProvisioningInfoState REMOTE +resources.postgres_synced_tables.*.synced_table_id string ALL +resources.postgres_synced_tables.*.timeseries_key string ALL +resources.postgres_synced_tables.*.uid string REMOTE +resources.postgres_synced_tables.*.url string INPUT +resources.quality_monitors.*.assets_dir string ALL +resources.quality_monitors.*.baseline_table_name string ALL +resources.quality_monitors.*.custom_metrics []catalog.MonitorMetric ALL +resources.quality_monitors.*.custom_metrics[*] catalog.MonitorMetric ALL +resources.quality_monitors.*.custom_metrics[*].definition string ALL +resources.quality_monitors.*.custom_metrics[*].input_columns []string ALL +resources.quality_monitors.*.custom_metrics[*].input_columns[*] string ALL +resources.quality_monitors.*.custom_metrics[*].name string ALL +resources.quality_monitors.*.custom_metrics[*].output_data_type string ALL +resources.quality_monitors.*.custom_metrics[*].type catalog.MonitorMetricType ALL +resources.quality_monitors.*.dashboard_id string REMOTE +resources.quality_monitors.*.data_classification_config *catalog.MonitorDataClassificationConfig ALL +resources.quality_monitors.*.data_classification_config.enabled bool ALL +resources.quality_monitors.*.drift_metrics_table_name string REMOTE +resources.quality_monitors.*.id string INPUT +resources.quality_monitors.*.inference_log *catalog.MonitorInferenceLog ALL +resources.quality_monitors.*.inference_log.granularities []string ALL +resources.quality_monitors.*.inference_log.granularities[*] string ALL +resources.quality_monitors.*.inference_log.label_col string ALL +resources.quality_monitors.*.inference_log.model_id_col string ALL +resources.quality_monitors.*.inference_log.prediction_col string ALL +resources.quality_monitors.*.inference_log.prediction_proba_col string ALL +resources.quality_monitors.*.inference_log.problem_type catalog.MonitorInferenceLogProblemType ALL +resources.quality_monitors.*.inference_log.timestamp_col string ALL +resources.quality_monitors.*.latest_monitor_failure_msg string ALL +resources.quality_monitors.*.lifecycle resources.Lifecycle INPUT +resources.quality_monitors.*.lifecycle.prevent_destroy bool INPUT +resources.quality_monitors.*.modified_status string INPUT +resources.quality_monitors.*.monitor_version int64 REMOTE +resources.quality_monitors.*.notifications *catalog.MonitorNotifications ALL +resources.quality_monitors.*.notifications.on_failure *catalog.MonitorDestination ALL +resources.quality_monitors.*.notifications.on_failure.email_addresses []string ALL +resources.quality_monitors.*.notifications.on_failure.email_addresses[*] string ALL +resources.quality_monitors.*.notifications.on_new_classification_tag_detected *catalog.MonitorDestination ALL +resources.quality_monitors.*.notifications.on_new_classification_tag_detected.email_addresses []string ALL +resources.quality_monitors.*.notifications.on_new_classification_tag_detected.email_addresses[*] string ALL +resources.quality_monitors.*.output_schema_name string ALL +resources.quality_monitors.*.profile_metrics_table_name string REMOTE +resources.quality_monitors.*.schedule *catalog.MonitorCronSchedule ALL +resources.quality_monitors.*.schedule.pause_status catalog.MonitorCronSchedulePauseStatus ALL +resources.quality_monitors.*.schedule.quartz_cron_expression string ALL +resources.quality_monitors.*.schedule.timezone_id string ALL +resources.quality_monitors.*.skip_builtin_dashboard bool INPUT STATE +resources.quality_monitors.*.slicing_exprs []string ALL +resources.quality_monitors.*.slicing_exprs[*] string ALL +resources.quality_monitors.*.snapshot *catalog.MonitorSnapshot ALL +resources.quality_monitors.*.status catalog.MonitorInfoStatus REMOTE +resources.quality_monitors.*.table_name string ALL +resources.quality_monitors.*.time_series *catalog.MonitorTimeSeries ALL +resources.quality_monitors.*.time_series.granularities []string ALL +resources.quality_monitors.*.time_series.granularities[*] string ALL +resources.quality_monitors.*.time_series.timestamp_col string ALL +resources.quality_monitors.*.url string INPUT +resources.quality_monitors.*.warehouse_id string INPUT STATE +resources.registered_models.*.aliases []catalog.RegisteredModelAlias ALL +resources.registered_models.*.aliases[*] catalog.RegisteredModelAlias ALL +resources.registered_models.*.aliases[*].alias_name string ALL +resources.registered_models.*.aliases[*].catalog_name string ALL +resources.registered_models.*.aliases[*].id string ALL +resources.registered_models.*.aliases[*].model_name string ALL +resources.registered_models.*.aliases[*].schema_name string ALL +resources.registered_models.*.aliases[*].version_num int ALL +resources.registered_models.*.browse_only bool ALL +resources.registered_models.*.catalog_name string ALL +resources.registered_models.*.comment string ALL +resources.registered_models.*.created_at int64 ALL +resources.registered_models.*.created_by string ALL +resources.registered_models.*.full_name string ALL +resources.registered_models.*.id string INPUT +resources.registered_models.*.lifecycle resources.Lifecycle INPUT +resources.registered_models.*.lifecycle.prevent_destroy bool INPUT +resources.registered_models.*.metastore_id string ALL +resources.registered_models.*.modified_status string INPUT +resources.registered_models.*.name string ALL +resources.registered_models.*.owner string ALL +resources.registered_models.*.schema_name string ALL +resources.registered_models.*.storage_location string ALL +resources.registered_models.*.updated_at int64 ALL +resources.registered_models.*.updated_by string ALL +resources.registered_models.*.url string INPUT +resources.registered_models.*.grants.full_name string ALL +resources.registered_models.*.grants.securable_type string ALL +resources.registered_models.*.grants[*] catalog.PrivilegeAssignment ALL +resources.registered_models.*.grants[*].principal string ALL +resources.registered_models.*.grants[*].privileges []catalog.Privilege ALL +resources.registered_models.*.grants[*].privileges[*] catalog.Privilege ALL +resources.schemas.*.browse_only bool REMOTE +resources.schemas.*.catalog_name string ALL +resources.schemas.*.catalog_type catalog.CatalogType REMOTE +resources.schemas.*.comment string ALL +resources.schemas.*.created_at int64 REMOTE +resources.schemas.*.created_by string REMOTE +resources.schemas.*.effective_predictive_optimization_flag *catalog.EffectivePredictiveOptimizationFlag REMOTE +resources.schemas.*.effective_predictive_optimization_flag.inherited_from_name string REMOTE +resources.schemas.*.effective_predictive_optimization_flag.inherited_from_type catalog.EffectivePredictiveOptimizationFlagInheritedFromType REMOTE +resources.schemas.*.effective_predictive_optimization_flag.value catalog.EnablePredictiveOptimization REMOTE +resources.schemas.*.enable_predictive_optimization catalog.EnablePredictiveOptimization REMOTE +resources.schemas.*.full_name string REMOTE +resources.schemas.*.id string INPUT +resources.schemas.*.lifecycle resources.Lifecycle INPUT +resources.schemas.*.lifecycle.prevent_destroy bool INPUT +resources.schemas.*.metastore_id string REMOTE +resources.schemas.*.modified_status string INPUT +resources.schemas.*.name string ALL +resources.schemas.*.owner string REMOTE +resources.schemas.*.properties map[string]string ALL +resources.schemas.*.properties.* string ALL +resources.schemas.*.schema_id string REMOTE +resources.schemas.*.storage_location string REMOTE +resources.schemas.*.storage_root string ALL +resources.schemas.*.updated_at int64 REMOTE +resources.schemas.*.updated_by string REMOTE +resources.schemas.*.url string INPUT +resources.schemas.*.grants.full_name string ALL +resources.schemas.*.grants.securable_type string ALL +resources.schemas.*.grants[*] catalog.PrivilegeAssignment ALL +resources.schemas.*.grants[*].principal string ALL +resources.schemas.*.grants[*].privileges []catalog.Privilege ALL +resources.schemas.*.grants[*].privileges[*] catalog.Privilege ALL +resources.secret_scopes.*.backend_azure_keyvault *workspace.AzureKeyVaultSecretScopeMetadata STATE +resources.secret_scopes.*.backend_azure_keyvault.dns_name string STATE +resources.secret_scopes.*.backend_azure_keyvault.resource_id string STATE +resources.secret_scopes.*.backend_type workspace.ScopeBackendType INPUT REMOTE +resources.secret_scopes.*.id string INPUT +resources.secret_scopes.*.initial_manage_principal string STATE +resources.secret_scopes.*.keyvault_metadata *workspace.AzureKeyVaultSecretScopeMetadata INPUT REMOTE +resources.secret_scopes.*.keyvault_metadata.dns_name string INPUT REMOTE +resources.secret_scopes.*.keyvault_metadata.resource_id string INPUT REMOTE +resources.secret_scopes.*.lifecycle resources.Lifecycle INPUT +resources.secret_scopes.*.lifecycle.prevent_destroy bool INPUT +resources.secret_scopes.*.modified_status string INPUT +resources.secret_scopes.*.name string INPUT REMOTE +resources.secret_scopes.*.scope string STATE +resources.secret_scopes.*.scope_backend_type workspace.ScopeBackendType STATE +resources.secret_scopes.*.url string INPUT +resources.secret_scopes.*.permissions.acls []workspace.AclItem ALL +resources.secret_scopes.*.permissions.acls[*] workspace.AclItem ALL +resources.secret_scopes.*.permissions.acls[*].permission workspace.AclPermission ALL +resources.secret_scopes.*.permissions.acls[*].principal string ALL +resources.secret_scopes.*.permissions.scope_name string ALL +resources.sql_warehouses.*.auto_stop_mins int ALL +resources.sql_warehouses.*.channel *sql.Channel ALL +resources.sql_warehouses.*.channel.dbsql_version string ALL +resources.sql_warehouses.*.channel.name sql.ChannelName ALL +resources.sql_warehouses.*.cluster_size string ALL +resources.sql_warehouses.*.creator_name string ALL +resources.sql_warehouses.*.enable_photon bool ALL +resources.sql_warehouses.*.enable_serverless_compute bool ALL +resources.sql_warehouses.*.health *sql.EndpointHealth REMOTE +resources.sql_warehouses.*.health.details string REMOTE +resources.sql_warehouses.*.health.failure_reason *sql.TerminationReason REMOTE +resources.sql_warehouses.*.health.failure_reason.code sql.TerminationReasonCode REMOTE +resources.sql_warehouses.*.health.failure_reason.parameters map[string]string REMOTE +resources.sql_warehouses.*.health.failure_reason.parameters.* string REMOTE +resources.sql_warehouses.*.health.failure_reason.type sql.TerminationReasonType REMOTE +resources.sql_warehouses.*.health.message string REMOTE +resources.sql_warehouses.*.health.status sql.Status REMOTE +resources.sql_warehouses.*.health.summary string REMOTE +resources.sql_warehouses.*.id string INPUT REMOTE +resources.sql_warehouses.*.instance_profile_arn string ALL +resources.sql_warehouses.*.jdbc_url string REMOTE +resources.sql_warehouses.*.lifecycle resources.Lifecycle INPUT +resources.sql_warehouses.*.lifecycle.prevent_destroy bool INPUT +resources.sql_warehouses.*.max_num_clusters int ALL +resources.sql_warehouses.*.min_num_clusters int ALL +resources.sql_warehouses.*.modified_status string INPUT +resources.sql_warehouses.*.name string ALL +resources.sql_warehouses.*.num_active_sessions int64 REMOTE +resources.sql_warehouses.*.num_clusters int REMOTE +resources.sql_warehouses.*.odbc_params *sql.OdbcParams REMOTE +resources.sql_warehouses.*.odbc_params.hostname string REMOTE +resources.sql_warehouses.*.odbc_params.path string REMOTE +resources.sql_warehouses.*.odbc_params.port int REMOTE +resources.sql_warehouses.*.odbc_params.protocol string REMOTE +resources.sql_warehouses.*.spot_instance_policy sql.SpotInstancePolicy ALL +resources.sql_warehouses.*.state sql.State REMOTE +resources.sql_warehouses.*.tags *sql.EndpointTags ALL +resources.sql_warehouses.*.tags.custom_tags []sql.EndpointTagPair ALL +resources.sql_warehouses.*.tags.custom_tags[*] sql.EndpointTagPair ALL +resources.sql_warehouses.*.tags.custom_tags[*].key string ALL +resources.sql_warehouses.*.tags.custom_tags[*].value string ALL +resources.sql_warehouses.*.url string INPUT +resources.sql_warehouses.*.warehouse_type sql.CreateWarehouseRequestWarehouseType INPUT STATE +resources.sql_warehouses.*.warehouse_type sql.GetWarehouseResponseWarehouseType REMOTE +resources.sql_warehouses.*.permissions.object_id string ALL +resources.sql_warehouses.*.permissions[*] dresources.StatePermission ALL +resources.sql_warehouses.*.permissions[*].group_name string ALL +resources.sql_warehouses.*.permissions[*].level iam.PermissionLevel ALL +resources.sql_warehouses.*.permissions[*].service_principal_name string ALL +resources.sql_warehouses.*.permissions[*].user_name string ALL +resources.synced_database_tables.*.data_synchronization_status *database.SyncedTableStatus ALL +resources.synced_database_tables.*.data_synchronization_status.continuous_update_status *database.SyncedTableContinuousUpdateStatus ALL +resources.synced_database_tables.*.data_synchronization_status.continuous_update_status.initial_pipeline_sync_progress *database.SyncedTablePipelineProgress ALL +resources.synced_database_tables.*.data_synchronization_status.continuous_update_status.initial_pipeline_sync_progress.estimated_completion_time_seconds float64 ALL +resources.synced_database_tables.*.data_synchronization_status.continuous_update_status.initial_pipeline_sync_progress.latest_version_currently_processing int64 ALL +resources.synced_database_tables.*.data_synchronization_status.continuous_update_status.initial_pipeline_sync_progress.provisioning_phase database.ProvisioningPhase ALL +resources.synced_database_tables.*.data_synchronization_status.continuous_update_status.initial_pipeline_sync_progress.sync_progress_completion float64 ALL +resources.synced_database_tables.*.data_synchronization_status.continuous_update_status.initial_pipeline_sync_progress.synced_row_count int64 ALL +resources.synced_database_tables.*.data_synchronization_status.continuous_update_status.initial_pipeline_sync_progress.total_row_count int64 ALL +resources.synced_database_tables.*.data_synchronization_status.continuous_update_status.last_processed_commit_version int64 ALL +resources.synced_database_tables.*.data_synchronization_status.continuous_update_status.timestamp string ALL +resources.synced_database_tables.*.data_synchronization_status.detailed_state database.SyncedTableState ALL +resources.synced_database_tables.*.data_synchronization_status.failed_status *database.SyncedTableFailedStatus ALL +resources.synced_database_tables.*.data_synchronization_status.failed_status.last_processed_commit_version int64 ALL +resources.synced_database_tables.*.data_synchronization_status.failed_status.timestamp string ALL +resources.synced_database_tables.*.data_synchronization_status.last_sync *database.SyncedTablePosition ALL +resources.synced_database_tables.*.data_synchronization_status.last_sync.delta_table_sync_info *database.DeltaTableSyncInfo ALL +resources.synced_database_tables.*.data_synchronization_status.last_sync.delta_table_sync_info.delta_commit_timestamp string ALL +resources.synced_database_tables.*.data_synchronization_status.last_sync.delta_table_sync_info.delta_commit_version int64 ALL +resources.synced_database_tables.*.data_synchronization_status.last_sync.sync_end_timestamp string ALL +resources.synced_database_tables.*.data_synchronization_status.last_sync.sync_start_timestamp string ALL +resources.synced_database_tables.*.data_synchronization_status.message string ALL +resources.synced_database_tables.*.data_synchronization_status.pipeline_id string ALL +resources.synced_database_tables.*.data_synchronization_status.provisioning_status *database.SyncedTableProvisioningStatus ALL +resources.synced_database_tables.*.data_synchronization_status.provisioning_status.initial_pipeline_sync_progress *database.SyncedTablePipelineProgress ALL +resources.synced_database_tables.*.data_synchronization_status.provisioning_status.initial_pipeline_sync_progress.estimated_completion_time_seconds float64 ALL +resources.synced_database_tables.*.data_synchronization_status.provisioning_status.initial_pipeline_sync_progress.latest_version_currently_processing int64 ALL +resources.synced_database_tables.*.data_synchronization_status.provisioning_status.initial_pipeline_sync_progress.provisioning_phase database.ProvisioningPhase ALL +resources.synced_database_tables.*.data_synchronization_status.provisioning_status.initial_pipeline_sync_progress.sync_progress_completion float64 ALL +resources.synced_database_tables.*.data_synchronization_status.provisioning_status.initial_pipeline_sync_progress.synced_row_count int64 ALL +resources.synced_database_tables.*.data_synchronization_status.provisioning_status.initial_pipeline_sync_progress.total_row_count int64 ALL +resources.synced_database_tables.*.data_synchronization_status.triggered_update_status *database.SyncedTableTriggeredUpdateStatus ALL +resources.synced_database_tables.*.data_synchronization_status.triggered_update_status.last_processed_commit_version int64 ALL +resources.synced_database_tables.*.data_synchronization_status.triggered_update_status.timestamp string ALL +resources.synced_database_tables.*.data_synchronization_status.triggered_update_status.triggered_update_progress *database.SyncedTablePipelineProgress ALL +resources.synced_database_tables.*.data_synchronization_status.triggered_update_status.triggered_update_progress.estimated_completion_time_seconds float64 ALL +resources.synced_database_tables.*.data_synchronization_status.triggered_update_status.triggered_update_progress.latest_version_currently_processing int64 ALL +resources.synced_database_tables.*.data_synchronization_status.triggered_update_status.triggered_update_progress.provisioning_phase database.ProvisioningPhase ALL +resources.synced_database_tables.*.data_synchronization_status.triggered_update_status.triggered_update_progress.sync_progress_completion float64 ALL +resources.synced_database_tables.*.data_synchronization_status.triggered_update_status.triggered_update_progress.synced_row_count int64 ALL +resources.synced_database_tables.*.data_synchronization_status.triggered_update_status.triggered_update_progress.total_row_count int64 ALL +resources.synced_database_tables.*.database_instance_name string ALL +resources.synced_database_tables.*.effective_database_instance_name string ALL +resources.synced_database_tables.*.effective_logical_database_name string ALL +resources.synced_database_tables.*.id string INPUT +resources.synced_database_tables.*.lifecycle resources.Lifecycle INPUT +resources.synced_database_tables.*.lifecycle.prevent_destroy bool INPUT +resources.synced_database_tables.*.logical_database_name string ALL +resources.synced_database_tables.*.modified_status string INPUT +resources.synced_database_tables.*.name string ALL +resources.synced_database_tables.*.spec *database.SyncedTableSpec ALL +resources.synced_database_tables.*.spec.create_database_objects_if_missing bool ALL +resources.synced_database_tables.*.spec.existing_pipeline_id string ALL +resources.synced_database_tables.*.spec.new_pipeline_spec *database.NewPipelineSpec ALL +resources.synced_database_tables.*.spec.new_pipeline_spec.budget_policy_id string ALL +resources.synced_database_tables.*.spec.new_pipeline_spec.storage_catalog string ALL +resources.synced_database_tables.*.spec.new_pipeline_spec.storage_schema string ALL +resources.synced_database_tables.*.spec.primary_key_columns []string ALL +resources.synced_database_tables.*.spec.primary_key_columns[*] string ALL +resources.synced_database_tables.*.spec.scheduling_policy database.SyncedTableSchedulingPolicy ALL +resources.synced_database_tables.*.spec.source_table_full_name string ALL +resources.synced_database_tables.*.spec.timeseries_key string ALL +resources.synced_database_tables.*.unity_catalog_provisioning_state database.ProvisioningInfoState ALL +resources.synced_database_tables.*.url string INPUT +resources.vector_search_endpoints.*.budget_policy_id string ALL +resources.vector_search_endpoints.*.creation_timestamp int64 REMOTE +resources.vector_search_endpoints.*.creator string REMOTE +resources.vector_search_endpoints.*.custom_tags []vectorsearch.CustomTag REMOTE +resources.vector_search_endpoints.*.custom_tags[*] vectorsearch.CustomTag REMOTE +resources.vector_search_endpoints.*.custom_tags[*].key string REMOTE +resources.vector_search_endpoints.*.custom_tags[*].value string REMOTE +resources.vector_search_endpoints.*.effective_budget_policy_id string REMOTE +resources.vector_search_endpoints.*.endpoint_status *vectorsearch.EndpointStatus REMOTE +resources.vector_search_endpoints.*.endpoint_status.message string REMOTE +resources.vector_search_endpoints.*.endpoint_status.state vectorsearch.EndpointStatusState REMOTE +resources.vector_search_endpoints.*.endpoint_type vectorsearch.EndpointType ALL +resources.vector_search_endpoints.*.endpoint_uuid string REMOTE +resources.vector_search_endpoints.*.id string INPUT REMOTE +resources.vector_search_endpoints.*.last_updated_timestamp int64 REMOTE +resources.vector_search_endpoints.*.last_updated_user string REMOTE +resources.vector_search_endpoints.*.lifecycle resources.Lifecycle INPUT +resources.vector_search_endpoints.*.lifecycle.prevent_destroy bool INPUT +resources.vector_search_endpoints.*.modified_status string INPUT +resources.vector_search_endpoints.*.name string ALL +resources.vector_search_endpoints.*.num_indexes int REMOTE +resources.vector_search_endpoints.*.scaling_info *vectorsearch.EndpointScalingInfo REMOTE +resources.vector_search_endpoints.*.scaling_info.requested_target_qps int64 REMOTE +resources.vector_search_endpoints.*.scaling_info.state vectorsearch.ScalingChangeState REMOTE +resources.vector_search_endpoints.*.target_qps int64 INPUT STATE +resources.vector_search_endpoints.*.url string INPUT +resources.vector_search_endpoints.*.usage_policy_id string INPUT STATE +resources.vector_search_endpoints.*.permissions.object_id string ALL +resources.vector_search_endpoints.*.permissions[*] dresources.StatePermission ALL +resources.vector_search_endpoints.*.permissions[*].group_name string ALL +resources.vector_search_endpoints.*.permissions[*].level iam.PermissionLevel ALL +resources.vector_search_endpoints.*.permissions[*].service_principal_name string ALL +resources.vector_search_endpoints.*.permissions[*].user_name string ALL +resources.volumes.*.access_point string REMOTE +resources.volumes.*.browse_only bool REMOTE +resources.volumes.*.catalog_name string ALL +resources.volumes.*.comment string ALL +resources.volumes.*.created_at int64 REMOTE +resources.volumes.*.created_by string REMOTE +resources.volumes.*.encryption_details *catalog.EncryptionDetails REMOTE +resources.volumes.*.encryption_details.sse_encryption_details *catalog.SseEncryptionDetails REMOTE +resources.volumes.*.encryption_details.sse_encryption_details.algorithm catalog.SseEncryptionDetailsAlgorithm REMOTE +resources.volumes.*.encryption_details.sse_encryption_details.aws_kms_key_arn string REMOTE +resources.volumes.*.full_name string REMOTE +resources.volumes.*.id string INPUT +resources.volumes.*.lifecycle resources.Lifecycle INPUT +resources.volumes.*.lifecycle.prevent_destroy bool INPUT +resources.volumes.*.metastore_id string REMOTE +resources.volumes.*.modified_status string INPUT +resources.volumes.*.name string ALL +resources.volumes.*.owner string REMOTE +resources.volumes.*.schema_name string ALL +resources.volumes.*.storage_location string ALL +resources.volumes.*.updated_at int64 REMOTE +resources.volumes.*.updated_by string REMOTE +resources.volumes.*.url string INPUT +resources.volumes.*.volume_id string REMOTE +resources.volumes.*.volume_type catalog.VolumeType ALL +resources.volumes.*.grants.full_name string ALL +resources.volumes.*.grants.securable_type string ALL +resources.volumes.*.grants[*] catalog.PrivilegeAssignment ALL +resources.volumes.*.grants[*].principal string ALL +resources.volumes.*.grants[*].privileges []catalog.Privilege ALL +resources.volumes.*.grants[*].privileges[*] catalog.Privilege ALL diff --git a/acceptance/bundle/refschema/output.txt b/acceptance/bundle/refschema/output.txt index 6afb35105c9..eadb6bf3b36 100644 --- a/acceptance/bundle/refschema/output.txt +++ b/acceptance/bundle/refschema/output.txt @@ -1,71 +1,22 @@ >>> [CLI] bundle debug refschema --help -Service for managing bundle deployment metadata. +Dumps all available fields for each resource type by walking the relevant types. Each line is a path to a field, type and set of tags: +- INPUT: field is present in bundle config. +- STATE: field is present in the state of the resource (direct deployment only). +- REMOTE: field is present in the remote state of the resource (direct deployment only). +- ALL: shortcut for all three. Usage: - databricks bundle [flags] - databricks bundle [command] - -Available Commands - complete-version Complete a version. - create-deployment Create a deployment. - create-operation Create an operation. - create-version Create a version. - delete-deployment Delete a deployment. - get-deployment Get a deployment. - get-operation Get an operation. - get-resource Get a resource. - get-version Get a version. - heartbeat Send a version heartbeat. - list-deployments List deployments. - list-operations List operations. - list-resources List resources. - list-versions List versions. + databricks bundle debug refschema [flags] Flags: - -h, --help help for bundle + -h, --help help for refschema Global Flags: --debug enable debug logging -o, --output type output type: text or json (default text) -p, --profile string ~/.databrickscfg profile -t, --target string bundle target to use (if applicable) - -Use "databricks bundle [command] --help" for more information about a command. + --var strings set values for variables defined in bundle config. Example: --var="foo=bar" >>> [CLI] bundle debug refschema -Error: unknown command "debug" for "databricks bundle" - -Usage: - databricks bundle [flags] - databricks bundle [command] - -Available Commands - complete-version Complete a version. - create-deployment Create a deployment. - create-operation Create an operation. - create-version Create a version. - delete-deployment Delete a deployment. - get-deployment Get a deployment. - get-operation Get an operation. - get-resource Get a resource. - get-version Get a version. - heartbeat Send a version heartbeat. - list-deployments List deployments. - list-operations List operations. - list-resources List resources. - list-versions List versions. - -Flags: - -h, --help help for bundle - -Global Flags: - --debug enable debug logging - -o, --output type output type: text or json (default text) - -p, --profile string ~/.databrickscfg profile - -t, --target string bundle target to use (if applicable) - -Use "databricks bundle [command] --help" for more information about a command. - - -Exit code: 1 diff --git a/cmd/cmd.go b/cmd/cmd.go index 263c1da0c11..1587fbdc7ea 100644 --- a/cmd/cmd.go +++ b/cmd/cmd.go @@ -57,6 +57,13 @@ func New(ctx context.Context) *cobra.Command { // Add workspace subcommands. workspaceCommands := workspace.All() for _, cmd := range workspaceCommands { + // The auto-generated `bundle` workspace service (DMS) shares its name + // with the DAB `bundle` command tree (cmd/bundle). Registering both + // here clobbers the DAB tree's help output. Skip the generated one; + // callers still have `databricks api ...` for the DMS endpoints. + if cmd.Name() == "bundle" { + continue + } // Order the permissions subcommands after the main commands. for _, sub := range cmd.Commands() { // some commands override groups in overrides.go, leave them as-is diff --git a/internal/genkit/tagging.py b/internal/genkit/tagging.py old mode 100755 new mode 100644 From 230d6e81c64201970f0c0cc04ec142345a58c04c Mon Sep 17 00:00:00 2001 From: Shreyas Goenka Date: Thu, 21 May 2026 13:37:57 +0000 Subject: [PATCH 3/7] Fix exhaustruct violations for new SDK fields SDK v0.136 added new fields to two request structs that the direct engine constructs: jobs.GetJobRequest.IncludeTriggerState (v0.136) and postgres.DeleteBranchRequest.{Purge,ForceSendFields} (v0.136). The exhaustruct linter requires explicit initialization of every field, so zero-value them out. No behavior change: both fields default to their zero values. Co-authored-by: Isaac --- bundle/direct/dresources/job.go | 7 ++++--- bundle/direct/dresources/postgres_branch.go | 4 +++- 2 files changed, 7 insertions(+), 4 deletions(-) diff --git a/bundle/direct/dresources/job.go b/bundle/direct/dresources/job.go index 9477bf52517..1b167cafee7 100644 --- a/bundle/direct/dresources/job.go +++ b/bundle/direct/dresources/job.go @@ -94,9 +94,10 @@ func (r *ResourceJob) DoRead(ctx context.Context, id string) (*JobRemote, error) // GetByJobId only fetches the first page (100 tasks). Jobs.Get handles // pagination and returns the complete job with all tasks merged. job, err := r.client.Jobs.Get(ctx, jobs.GetJobRequest{ - JobId: idInt, - PageToken: "", - ForceSendFields: nil, + JobId: idInt, + PageToken: "", + IncludeTriggerState: false, + ForceSendFields: nil, }) if err != nil { return nil, err diff --git a/bundle/direct/dresources/postgres_branch.go b/bundle/direct/dresources/postgres_branch.go index 4f99d33ff53..625cccc5282 100644 --- a/bundle/direct/dresources/postgres_branch.go +++ b/bundle/direct/dresources/postgres_branch.go @@ -174,7 +174,9 @@ func (r *ResourcePostgresBranch) DoUpdate(ctx context.Context, id string, config func (r *ResourcePostgresBranch) DoDelete(ctx context.Context, id string) error { waiter, err := r.client.Postgres.DeleteBranch(ctx, postgres.DeleteBranchRequest{ - Name: id, + Name: id, + Purge: false, + ForceSendFields: nil, }) if err != nil { return err From 4a0ab3cc446851d76b28dead3c750a92f3cdb09b Mon Sep 17 00:00:00 2001 From: Shreyas Goenka Date: Thu, 21 May 2026 13:48:16 +0000 Subject: [PATCH 4/7] Refresh test goldens and fixtures for SDK v0.136 surface changes Four small fixes for tests that detect SDK-bump-driven changes: - `libs/databrickscfg/cfgpickers/clusters_test.go`: the SDK's `CurrentUser.Me(ctx, iam.MeRequest{})` now hits `/api/2.0/preview/scim/v2/Me?` with a trailing `?` (the URL builder appends one for the empty query-param shape, even when both fields are zero-valued). The two `qa.HTTPFixture` stubs were matching the pre-bump path; update them to include the trailing `?`. - `libs/structs/structwalk/walktype_test.go`: bump the upper bounds on the reflective field-count tests (jobs.JobSettings now 605, was 533 pre-bump; config.Root now 5651, was 5213) and refresh the comments. The lower bounds are unchanged. - `acceptance/cmd/account/account-help/output.txt`: the `endpoints` service moved from Beta to Public Preview in the SDK launch-stage metadata. - `acceptance/help/output.txt`: vector-search-endpoints description rewording ("vector search indexes" -> "AI Search indexes") and a new `temporary-volume-credentials` row in the Unity Catalog group, both from SDK v0.136 service additions. Co-authored-by: Isaac --- acceptance/cmd/account/account-help/output.txt | 2 +- acceptance/help/output.txt | 3 ++- libs/databrickscfg/cfgpickers/clusters_test.go | 4 ++-- libs/structs/structwalk/walktype_test.go | 6 +++--- 4 files changed, 8 insertions(+), 7 deletions(-) diff --git a/acceptance/cmd/account/account-help/output.txt b/acceptance/cmd/account/account-help/output.txt index f3e883750f6..1687f96d466 100644 --- a/acceptance/cmd/account/account-help/output.txt +++ b/acceptance/cmd/account/account-help/output.txt @@ -32,7 +32,7 @@ Settings Provisioning credentials These APIs manage credential configurations for this workspace. encryption-keys These APIs manage encryption key configurations for this workspace (optional). - endpoints *Beta* These APIs manage endpoint configurations for this account. + endpoints *Public Preview* These APIs manage endpoint configurations for this account. networks These APIs manage network configurations for customer-managed VPCs (optional). private-access These APIs manage private access settings for this account. storage These APIs manage storage configurations for this workspace. diff --git a/acceptance/help/output.txt b/acceptance/help/output.txt index af62067b5c6..453ec28b84b 100644 --- a/acceptance/help/output.txt +++ b/acceptance/help/output.txt @@ -36,7 +36,7 @@ Apps apps Apps run directly on a customer's Databricks instance, integrate with their data, use and extend Databricks services, and enable users to interact through single sign-on. Vector Search - vector-search-endpoints **Endpoint**: Represents the compute resources to host vector search indexes. + vector-search-endpoints **Endpoint**: Represents the compute resources to host AI Search indexes. vector-search-indexes **Index**: An efficient representation of your embedding vectors that supports real-time and efficient approximate nearest neighbor (ANN) search queries. Identity and Access Management @@ -92,6 +92,7 @@ Unity Catalog tables A table resides in the third layer of Unity Catalog’s three-level namespace. temporary-path-credentials *Public Preview* Temporary Path Credentials refer to short-lived, downscoped credentials used to access external cloud storage locations registered in Databricks. temporary-table-credentials *Public Preview* Temporary Table Credentials refer to short-lived, downscoped credentials used to access cloud storage locations where table data is stored in Databricks. + temporary-volume-credentials *Public Preview* Temporary Volume Credentials refer to short-lived, downscoped credentials used to access cloud storage locations where volume data is stored in Databricks. volumes Volumes are a Unity Catalog (UC) capability for accessing, storing, governing, organizing and processing files. workspace-bindings A securable in Databricks can be configured as __OPEN__ or __ISOLATED__. diff --git a/libs/databrickscfg/cfgpickers/clusters_test.go b/libs/databrickscfg/cfgpickers/clusters_test.go index 025a0f43253..4fad46e038b 100644 --- a/libs/databrickscfg/cfgpickers/clusters_test.go +++ b/libs/databrickscfg/cfgpickers/clusters_test.go @@ -92,7 +92,7 @@ func TestFirstCompatibleCluster(t *testing.T) { }, { Method: "GET", - Resource: "/api/2.0/preview/scim/v2/Me", + Resource: "/api/2.0/preview/scim/v2/Me?", Response: iam.User{ UserName: "serge", }, @@ -139,7 +139,7 @@ func TestNoCompatibleClusters(t *testing.T) { }, { Method: "GET", - Resource: "/api/2.0/preview/scim/v2/Me", + Resource: "/api/2.0/preview/scim/v2/Me?", Response: iam.User{ UserName: "serge", }, diff --git a/libs/structs/structwalk/walktype_test.go b/libs/structs/structwalk/walktype_test.go index d77002982a9..5db64efc0d7 100644 --- a/libs/structs/structwalk/walktype_test.go +++ b/libs/structs/structwalk/walktype_test.go @@ -112,8 +112,8 @@ func testStruct(t *testing.T, typ reflect.Type, minLen, maxLen int, present map[ func TestTypeJobSettings(t *testing.T) { testStruct(t, reflect.TypeFor[jobs.JobSettings](), - // Verify we found a reasonable number of fields (it's 533 at the time of writing) - 500, 600, + // Verify we found a reasonable number of fields (605 after SDK v0.136.0 bump) + 500, 650, map[string]any{ "name": "", "timeout_seconds": 0, @@ -136,7 +136,7 @@ func TestTypeJobSettings(t *testing.T) { func TestTypeRoot(t *testing.T) { testStruct(t, reflect.TypeFor[config.Root](), - 5000, 5500, // 5213 after SDK v0.127.0 bump + 5000, 5800, // 5651 after SDK v0.136.0 bump map[string]any{ "bundle.target": "", `variables.*.lookup.dashboard`: "", From c91a11f779000ac38d4d0f6ba28583a79c26027a Mon Sep 17 00:00:00 2001 From: Shreyas Goenka Date: Fri, 22 May 2026 09:25:51 +0000 Subject: [PATCH 5/7] Fix trailing whitespace + revert tagging.py.lock to main Two CI-cleanup nits flagged on PR #5298: - `cmd/workspace/bundle/bundle.go`: the genkit-generated cobra command set contains a few lines that ended with two trailing spaces inside multi-line backtick strings; the whitespace validator strips them. Run it once and commit the result. - `internal/genkit/tagging.py.lock`: the previous codegen run picked a different pypi-proxy host (`pypi-proxy.cloud.databricks.com`) than main's lock (`pypi-proxy.dev.databricks.com`) -- artifact of where uv resolved deps in the bump-time env. Revert to main; this file shouldn't drift across an SDK bump. Co-authored-by: Isaac --- cmd/workspace/bundle/bundle.go | 46 ++++++++++++++++----------------- internal/genkit/tagging.py.lock | 24 ++++++++--------- 2 files changed, 35 insertions(+), 35 deletions(-) diff --git a/cmd/workspace/bundle/bundle.go b/cmd/workspace/bundle/bundle.go index e7bd045f3a3..ee6e38addea 100755 --- a/cmd/workspace/bundle/bundle.go +++ b/cmd/workspace/bundle/bundle.go @@ -79,9 +79,9 @@ func newCompleteVersion() *cobra.Command { cmd.Use = "complete-version NAME COMPLETION_REASON" cmd.Short = `Complete a version.` cmd.Long = `Complete a version. - + Marks a version as complete and releases the deployment lock. - + The server atomically: 1. Sets the version status to the provided terminal status. 2. Sets complete_time to the current server timestamp. 3. Releases the lock on the parent deployment. 4. Updates the parent deployment's status @@ -92,7 +92,7 @@ func newCompleteVersion() *cobra.Command { deployments/{deployment_id}/versions/{version_id} COMPLETION_REASON: The reason for completing the version. Must be a terminal reason: VERSION_COMPLETE_SUCCESS, VERSION_COMPLETE_FAILURE, or - VERSION_COMPLETE_FORCE_ABORT. + VERSION_COMPLETE_FORCE_ABORT. Supported values: [VERSION_COMPLETE_FAILURE, VERSION_COMPLETE_FORCE_ABORT, VERSION_COMPLETE_LEASE_EXPIRED, VERSION_COMPLETE_SUCCESS]` cmd.Annotations = make(map[string]string) @@ -181,9 +181,9 @@ func newCreateDeployment() *cobra.Command { cmd.Use = "create-deployment DEPLOYMENT_ID" cmd.Short = `Create a deployment.` cmd.Long = `Create a deployment. - + Creates a new deployment in the workspace. - + The caller must provide a deployment_id which becomes the final component of the deployment's resource name. If a deployment with the same ID already exists, the server returns ALREADY_EXISTS. @@ -261,13 +261,13 @@ func newCreateOperation() *cobra.Command { cmd.Use = "create-operation PARENT" cmd.Short = `Create an operation.` cmd.Long = `Create an operation. - + Creates a resource operation under a version. - + The caller must provide a resource_key which becomes the final component of the operation's name. If an operation with the same key already exists under the version, the server returns ALREADY_EXISTS. - + On success the server also updates the corresponding deployment-level Resource (creating it if this is the first operation for that resource_key, or removing it if action_type is DELETE). @@ -357,9 +357,9 @@ func newCreateVersion() *cobra.Command { cmd.Use = "create-version PARENT VERSION_ID CLI_VERSION VERSION_TYPE" cmd.Short = `Create a version.` cmd.Long = `Create a version. - + Creates a new version under a deployment. - + Creating a version acquires an exclusive lock on the deployment, preventing concurrent deploys. The caller provides a version_id which the server validates equals last_version_id + 1 on the deployment. @@ -371,7 +371,7 @@ func newCreateVersion() *cobra.Command { equals last_version_id + 1 on the deployment. If it doesn't match, the server returns ABORTED. CLI_VERSION: CLI version used to initiate the version. - VERSION_TYPE: Type of version (deploy or destroy). + VERSION_TYPE: Type of version (deploy or destroy). Supported values: [VERSION_TYPE_DEPLOY, VERSION_TYPE_DESTROY]` cmd.Annotations = make(map[string]string) @@ -457,9 +457,9 @@ func newDeleteDeployment() *cobra.Command { cmd.Use = "delete-deployment NAME" cmd.Short = `Delete a deployment.` cmd.Long = `Delete a deployment. - + Deletes a deployment. - + The deployment is marked as deleted. It and all its children (versions and their operations) will be permanently deleted after the retention policy expires. If the deployment has an in-progress version, the server returns @@ -521,7 +521,7 @@ func newGetDeployment() *cobra.Command { cmd.Use = "get-deployment NAME" cmd.Short = `Get a deployment.` cmd.Long = `Get a deployment. - + Retrieves a deployment by its resource name. Arguments: @@ -581,7 +581,7 @@ func newGetOperation() *cobra.Command { cmd.Use = "get-operation NAME" cmd.Short = `Get an operation.` cmd.Long = `Get an operation. - + Retrieves a resource operation by its resource name. Arguments: @@ -641,7 +641,7 @@ func newGetResource() *cobra.Command { cmd.Use = "get-resource NAME" cmd.Short = `Get a resource.` cmd.Long = `Get a resource. - + Retrieves a deployment resource by its resource name. Arguments: @@ -701,7 +701,7 @@ func newGetVersion() *cobra.Command { cmd.Use = "get-version NAME" cmd.Short = `Get a version.` cmd.Long = `Get a version. - + Retrieves a version by its resource name. Arguments: @@ -761,9 +761,9 @@ func newHeartbeat() *cobra.Command { cmd.Use = "heartbeat NAME" cmd.Short = `Send a version heartbeat.` cmd.Long = `Send a version heartbeat. - + Sends a heartbeat to renew the lock held by a version. - + The server validates that the version is the active (non-terminal) version on the parent deployment and resets the lock expiry. If the lock has already expired or the version is no longer active, the server returns ABORTED. @@ -838,7 +838,7 @@ func newListDeployments() *cobra.Command { cmd.Use = "list-deployments" cmd.Short = `List deployments.` cmd.Long = `List deployments. - + Lists deployments in the workspace.` cmd.Annotations = make(map[string]string) @@ -908,7 +908,7 @@ func newListOperations() *cobra.Command { cmd.Use = "list-operations PARENT" cmd.Short = `List operations.` cmd.Long = `List operations. - + Lists resource operations under a version. Arguments: @@ -984,7 +984,7 @@ func newListResources() *cobra.Command { cmd.Use = "list-resources PARENT" cmd.Short = `List resources.` cmd.Long = `List resources. - + Lists resources under a deployment. Arguments: @@ -1059,7 +1059,7 @@ func newListVersions() *cobra.Command { cmd.Use = "list-versions PARENT" cmd.Short = `List versions.` cmd.Long = `List versions. - + Lists versions under a deployment, ordered by version_id descending (most recent first). diff --git a/internal/genkit/tagging.py.lock b/internal/genkit/tagging.py.lock index 2bd746a66c2..d680b187f5b 100644 --- a/internal/genkit/tagging.py.lock +++ b/internal/genkit/tagging.py.lock @@ -12,7 +12,7 @@ requirements = [ [[package]] name = "certifi" version = "2026.2.25" -source = { registry = "https://pypi-proxy.cloud.databricks.com/simple/" } +source = { registry = "https://pypi-proxy.dev.databricks.com/simple/" } sdist = { url = "https://files.pythonhosted.org/packages/af/2d/7bf41579a8986e348fa033a31cdd0e4121114f6bce2457e8876010b092dd/certifi-2026.2.25.tar.gz", hash = "sha256:e887ab5cee78ea814d3472169153c2d12cd43b14bd03329a39a9c6e2e80bfba7", size = 155029, upload-time = "2026-02-25T02:54:17.342Z" } wheels = [ { url = "https://files.pythonhosted.org/packages/9a/3c/c17fb3ca2d9c3acff52e30b309f538586f9f5b9c9cf454f3845fc9af4881/certifi-2026.2.25-py3-none-any.whl", hash = "sha256:027692e4402ad994f1c42e52a4997a9763c646b73e4096e4d5d6db8af1d6f0fa", size = 153684, upload-time = "2026-02-25T02:54:15.766Z" }, @@ -21,7 +21,7 @@ wheels = [ [[package]] name = "cffi" version = "2.0.0" -source = { registry = "https://pypi-proxy.cloud.databricks.com/simple/" } +source = { registry = "https://pypi-proxy.dev.databricks.com/simple/" } dependencies = [ { name = "pycparser", marker = "implementation_name != 'PyPy'" }, ] @@ -78,7 +78,7 @@ wheels = [ [[package]] name = "charset-normalizer" version = "3.4.5" -source = { registry = "https://pypi-proxy.cloud.databricks.com/simple/" } +source = { registry = "https://pypi-proxy.dev.databricks.com/simple/" } sdist = { url = "https://files.pythonhosted.org/packages/1d/35/02daf95b9cd686320bb622eb148792655c9412dbb9b67abb5694e5910a24/charset_normalizer-3.4.5.tar.gz", hash = "sha256:95adae7b6c42a6c5b5b559b1a99149f090a57128155daeea91732c8d970d8644", size = 134804, upload-time = "2026-03-06T06:03:19.46Z" } wheels = [ { url = "https://files.pythonhosted.org/packages/9c/b6/9ee9c1a608916ca5feae81a344dffbaa53b26b90be58cc2159e3332d44ec/charset_normalizer-3.4.5-cp312-cp312-macosx_10_13_universal2.whl", hash = "sha256:ed97c282ee4f994ef814042423a529df9497e3c666dca19be1d4cd1129dc7ade", size = 280976, upload-time = "2026-03-06T06:01:15.276Z" }, @@ -135,7 +135,7 @@ wheels = [ [[package]] name = "cryptography" version = "46.0.5" -source = { registry = "https://pypi-proxy.cloud.databricks.com/simple/" } +source = { registry = "https://pypi-proxy.dev.databricks.com/simple/" } dependencies = [ { name = "cffi", marker = "platform_python_implementation != 'PyPy'" }, ] @@ -188,7 +188,7 @@ wheels = [ [[package]] name = "idna" version = "3.11" -source = { registry = "https://pypi-proxy.cloud.databricks.com/simple/" } +source = { registry = "https://pypi-proxy.dev.databricks.com/simple/" } sdist = { url = "https://files.pythonhosted.org/packages/6f/6d/0703ccc57f3a7233505399edb88de3cbd678da106337b9fcde432b65ed60/idna-3.11.tar.gz", hash = "sha256:795dafcc9c04ed0c1fb032c2aa73654d8e8c5023a7df64a53f39190ada629902", size = 194582, upload-time = "2025-10-12T14:55:20.501Z" } wheels = [ { url = "https://files.pythonhosted.org/packages/0e/61/66938bbb5fc52dbdf84594873d5b51fb1f7c7794e9c0f5bd885f30bc507b/idna-3.11-py3-none-any.whl", hash = "sha256:771a87f49d9defaf64091e6e6fe9c18d4833f140bd19464795bc32d966ca37ea", size = 71008, upload-time = "2025-10-12T14:55:18.883Z" }, @@ -197,7 +197,7 @@ wheels = [ [[package]] name = "pycparser" version = "3.0" -source = { registry = "https://pypi-proxy.cloud.databricks.com/simple/" } +source = { registry = "https://pypi-proxy.dev.databricks.com/simple/" } sdist = { url = "https://files.pythonhosted.org/packages/1b/7d/92392ff7815c21062bea51aa7b87d45576f649f16458d78b7cf94b9ab2e6/pycparser-3.0.tar.gz", hash = "sha256:600f49d217304a5902ac3c37e1281c9fe94e4d0489de643a9504c5cdfdfc6b29", size = 103492, upload-time = "2026-01-21T14:26:51.89Z" } wheels = [ { url = "https://files.pythonhosted.org/packages/0c/c3/44f3fbbfa403ea2a7c779186dc20772604442dde72947e7d01069cbe98e3/pycparser-3.0-py3-none-any.whl", hash = "sha256:b727414169a36b7d524c1c3e31839a521725078d7b2ff038656844266160a992", size = 48172, upload-time = "2026-01-21T14:26:50.693Z" }, @@ -206,7 +206,7 @@ wheels = [ [[package]] name = "pygithub" version = "2.8.1" -source = { registry = "https://pypi-proxy.cloud.databricks.com/simple/" } +source = { registry = "https://pypi-proxy.dev.databricks.com/simple/" } dependencies = [ { name = "pyjwt", extra = ["crypto"] }, { name = "pynacl" }, @@ -222,7 +222,7 @@ wheels = [ [[package]] name = "pyjwt" version = "2.11.0" -source = { registry = "https://pypi-proxy.cloud.databricks.com/simple/" } +source = { registry = "https://pypi-proxy.dev.databricks.com/simple/" } sdist = { url = "https://files.pythonhosted.org/packages/5c/5a/b46fa56bf322901eee5b0454a34343cdbdae202cd421775a8ee4e42fd519/pyjwt-2.11.0.tar.gz", hash = "sha256:35f95c1f0fbe5d5ba6e43f00271c275f7a1a4db1dab27bf708073b75318ea623", size = 98019, upload-time = "2026-01-30T19:59:55.694Z" } wheels = [ { url = "https://files.pythonhosted.org/packages/6f/01/c26ce75ba460d5cd503da9e13b21a33804d38c2165dec7b716d06b13010c/pyjwt-2.11.0-py3-none-any.whl", hash = "sha256:94a6bde30eb5c8e04fee991062b534071fd1439ef58d2adc9ccb823e7bcd0469", size = 28224, upload-time = "2026-01-30T19:59:54.539Z" }, @@ -236,7 +236,7 @@ crypto = [ [[package]] name = "pynacl" version = "1.6.2" -source = { registry = "https://pypi-proxy.cloud.databricks.com/simple/" } +source = { registry = "https://pypi-proxy.dev.databricks.com/simple/" } dependencies = [ { name = "cffi", marker = "platform_python_implementation != 'PyPy'" }, ] @@ -271,7 +271,7 @@ wheels = [ [[package]] name = "requests" version = "2.32.5" -source = { registry = "https://pypi-proxy.cloud.databricks.com/simple/" } +source = { registry = "https://pypi-proxy.dev.databricks.com/simple/" } dependencies = [ { name = "certifi" }, { name = "charset-normalizer" }, @@ -286,7 +286,7 @@ wheels = [ [[package]] name = "typing-extensions" version = "4.15.0" -source = { registry = "https://pypi-proxy.cloud.databricks.com/simple/" } +source = { registry = "https://pypi-proxy.dev.databricks.com/simple/" } sdist = { url = "https://files.pythonhosted.org/packages/72/94/1a15dd82efb362ac84269196e94cf00f187f7ed21c242792a923cdb1c61f/typing_extensions-4.15.0.tar.gz", hash = "sha256:0cea48d173cc12fa28ecabc3b837ea3cf6f38c6d1136f85cbaaf598984861466", size = 109391, upload-time = "2025-08-25T13:49:26.313Z" } wheels = [ { url = "https://files.pythonhosted.org/packages/18/67/36e9267722cc04a6b9f15c7f3441c2363321a3ea07da7ae0c0707beb2a9c/typing_extensions-4.15.0-py3-none-any.whl", hash = "sha256:f0fa19c6845758ab08074a0cfa8b7aecb71c999ca73d62883bc25cc018c4e548", size = 44614, upload-time = "2025-08-25T13:49:24.86Z" }, @@ -295,7 +295,7 @@ wheels = [ [[package]] name = "urllib3" version = "2.6.3" -source = { registry = "https://pypi-proxy.cloud.databricks.com/simple/" } +source = { registry = "https://pypi-proxy.dev.databricks.com/simple/" } sdist = { url = "https://files.pythonhosted.org/packages/c7/24/5f1b3bdffd70275f6661c76461e25f024d5a38a46f04aaca912426a2b1d3/urllib3-2.6.3.tar.gz", hash = "sha256:1b62b6884944a57dbe321509ab94fd4d3b307075e0c2eae991ac71ee15ad38ed", size = 435556, upload-time = "2026-01-07T16:24:43.925Z" } wheels = [ { url = "https://files.pythonhosted.org/packages/39/08/aaaad47bc4e9dc8c725e68f9d04865dbcb2052843ff09c97b08904852d84/urllib3-2.6.3-py3-none-any.whl", hash = "sha256:bf272323e553dfb2e87d9bfd225ca7b0f467b919d7bbd355436d3fd37cb0acd4", size = 131584, upload-time = "2026-01-07T16:24:42.685Z" }, From dd1c3049e4d31501d8ef454261e7c4d271e1dcda Mon Sep 17 00:00:00 2001 From: Shreyas Goenka Date: Fri, 22 May 2026 09:30:08 +0000 Subject: [PATCH 6/7] Revert revert: keep tagging.py.lock on cloud.databricks.com registry I jumped the gun reverting this in c91a11f77. Verified against the Go SDK's own tagging.py.lock across versions: v0.132.0 -> pypi-proxy.dev.databricks.com v0.136.0 -> pypi-proxy.cloud.databricks.com (and SDK main today) So the registry URL migration from dev -> cloud is exactly what genkit ships across this SDK version range. The codegen run for the bump picked it up correctly the first time. Co-authored-by: Isaac --- internal/genkit/tagging.py.lock | 24 ++++++++++++------------ 1 file changed, 12 insertions(+), 12 deletions(-) diff --git a/internal/genkit/tagging.py.lock b/internal/genkit/tagging.py.lock index d680b187f5b..2bd746a66c2 100644 --- a/internal/genkit/tagging.py.lock +++ b/internal/genkit/tagging.py.lock @@ -12,7 +12,7 @@ requirements = [ [[package]] name = "certifi" version = "2026.2.25" -source = { registry = "https://pypi-proxy.dev.databricks.com/simple/" } +source = { registry = "https://pypi-proxy.cloud.databricks.com/simple/" } sdist = { url = "https://files.pythonhosted.org/packages/af/2d/7bf41579a8986e348fa033a31cdd0e4121114f6bce2457e8876010b092dd/certifi-2026.2.25.tar.gz", hash = "sha256:e887ab5cee78ea814d3472169153c2d12cd43b14bd03329a39a9c6e2e80bfba7", size = 155029, upload-time = "2026-02-25T02:54:17.342Z" } wheels = [ { url = "https://files.pythonhosted.org/packages/9a/3c/c17fb3ca2d9c3acff52e30b309f538586f9f5b9c9cf454f3845fc9af4881/certifi-2026.2.25-py3-none-any.whl", hash = "sha256:027692e4402ad994f1c42e52a4997a9763c646b73e4096e4d5d6db8af1d6f0fa", size = 153684, upload-time = "2026-02-25T02:54:15.766Z" }, @@ -21,7 +21,7 @@ wheels = [ [[package]] name = "cffi" version = "2.0.0" -source = { registry = "https://pypi-proxy.dev.databricks.com/simple/" } +source = { registry = "https://pypi-proxy.cloud.databricks.com/simple/" } dependencies = [ { name = "pycparser", marker = "implementation_name != 'PyPy'" }, ] @@ -78,7 +78,7 @@ wheels = [ [[package]] name = "charset-normalizer" version = "3.4.5" -source = { registry = "https://pypi-proxy.dev.databricks.com/simple/" } +source = { registry = "https://pypi-proxy.cloud.databricks.com/simple/" } sdist = { url = "https://files.pythonhosted.org/packages/1d/35/02daf95b9cd686320bb622eb148792655c9412dbb9b67abb5694e5910a24/charset_normalizer-3.4.5.tar.gz", hash = "sha256:95adae7b6c42a6c5b5b559b1a99149f090a57128155daeea91732c8d970d8644", size = 134804, upload-time = "2026-03-06T06:03:19.46Z" } wheels = [ { url = "https://files.pythonhosted.org/packages/9c/b6/9ee9c1a608916ca5feae81a344dffbaa53b26b90be58cc2159e3332d44ec/charset_normalizer-3.4.5-cp312-cp312-macosx_10_13_universal2.whl", hash = "sha256:ed97c282ee4f994ef814042423a529df9497e3c666dca19be1d4cd1129dc7ade", size = 280976, upload-time = "2026-03-06T06:01:15.276Z" }, @@ -135,7 +135,7 @@ wheels = [ [[package]] name = "cryptography" version = "46.0.5" -source = { registry = "https://pypi-proxy.dev.databricks.com/simple/" } +source = { registry = "https://pypi-proxy.cloud.databricks.com/simple/" } dependencies = [ { name = "cffi", marker = "platform_python_implementation != 'PyPy'" }, ] @@ -188,7 +188,7 @@ wheels = [ [[package]] name = "idna" version = "3.11" -source = { registry = "https://pypi-proxy.dev.databricks.com/simple/" } +source = { registry = "https://pypi-proxy.cloud.databricks.com/simple/" } sdist = { url = "https://files.pythonhosted.org/packages/6f/6d/0703ccc57f3a7233505399edb88de3cbd678da106337b9fcde432b65ed60/idna-3.11.tar.gz", hash = "sha256:795dafcc9c04ed0c1fb032c2aa73654d8e8c5023a7df64a53f39190ada629902", size = 194582, upload-time = "2025-10-12T14:55:20.501Z" } wheels = [ { url = "https://files.pythonhosted.org/packages/0e/61/66938bbb5fc52dbdf84594873d5b51fb1f7c7794e9c0f5bd885f30bc507b/idna-3.11-py3-none-any.whl", hash = "sha256:771a87f49d9defaf64091e6e6fe9c18d4833f140bd19464795bc32d966ca37ea", size = 71008, upload-time = "2025-10-12T14:55:18.883Z" }, @@ -197,7 +197,7 @@ wheels = [ [[package]] name = "pycparser" version = "3.0" -source = { registry = "https://pypi-proxy.dev.databricks.com/simple/" } +source = { registry = "https://pypi-proxy.cloud.databricks.com/simple/" } sdist = { url = "https://files.pythonhosted.org/packages/1b/7d/92392ff7815c21062bea51aa7b87d45576f649f16458d78b7cf94b9ab2e6/pycparser-3.0.tar.gz", hash = "sha256:600f49d217304a5902ac3c37e1281c9fe94e4d0489de643a9504c5cdfdfc6b29", size = 103492, upload-time = "2026-01-21T14:26:51.89Z" } wheels = [ { url = "https://files.pythonhosted.org/packages/0c/c3/44f3fbbfa403ea2a7c779186dc20772604442dde72947e7d01069cbe98e3/pycparser-3.0-py3-none-any.whl", hash = "sha256:b727414169a36b7d524c1c3e31839a521725078d7b2ff038656844266160a992", size = 48172, upload-time = "2026-01-21T14:26:50.693Z" }, @@ -206,7 +206,7 @@ wheels = [ [[package]] name = "pygithub" version = "2.8.1" -source = { registry = "https://pypi-proxy.dev.databricks.com/simple/" } +source = { registry = "https://pypi-proxy.cloud.databricks.com/simple/" } dependencies = [ { name = "pyjwt", extra = ["crypto"] }, { name = "pynacl" }, @@ -222,7 +222,7 @@ wheels = [ [[package]] name = "pyjwt" version = "2.11.0" -source = { registry = "https://pypi-proxy.dev.databricks.com/simple/" } +source = { registry = "https://pypi-proxy.cloud.databricks.com/simple/" } sdist = { url = "https://files.pythonhosted.org/packages/5c/5a/b46fa56bf322901eee5b0454a34343cdbdae202cd421775a8ee4e42fd519/pyjwt-2.11.0.tar.gz", hash = "sha256:35f95c1f0fbe5d5ba6e43f00271c275f7a1a4db1dab27bf708073b75318ea623", size = 98019, upload-time = "2026-01-30T19:59:55.694Z" } wheels = [ { url = "https://files.pythonhosted.org/packages/6f/01/c26ce75ba460d5cd503da9e13b21a33804d38c2165dec7b716d06b13010c/pyjwt-2.11.0-py3-none-any.whl", hash = "sha256:94a6bde30eb5c8e04fee991062b534071fd1439ef58d2adc9ccb823e7bcd0469", size = 28224, upload-time = "2026-01-30T19:59:54.539Z" }, @@ -236,7 +236,7 @@ crypto = [ [[package]] name = "pynacl" version = "1.6.2" -source = { registry = "https://pypi-proxy.dev.databricks.com/simple/" } +source = { registry = "https://pypi-proxy.cloud.databricks.com/simple/" } dependencies = [ { name = "cffi", marker = "platform_python_implementation != 'PyPy'" }, ] @@ -271,7 +271,7 @@ wheels = [ [[package]] name = "requests" version = "2.32.5" -source = { registry = "https://pypi-proxy.dev.databricks.com/simple/" } +source = { registry = "https://pypi-proxy.cloud.databricks.com/simple/" } dependencies = [ { name = "certifi" }, { name = "charset-normalizer" }, @@ -286,7 +286,7 @@ wheels = [ [[package]] name = "typing-extensions" version = "4.15.0" -source = { registry = "https://pypi-proxy.dev.databricks.com/simple/" } +source = { registry = "https://pypi-proxy.cloud.databricks.com/simple/" } sdist = { url = "https://files.pythonhosted.org/packages/72/94/1a15dd82efb362ac84269196e94cf00f187f7ed21c242792a923cdb1c61f/typing_extensions-4.15.0.tar.gz", hash = "sha256:0cea48d173cc12fa28ecabc3b837ea3cf6f38c6d1136f85cbaaf598984861466", size = 109391, upload-time = "2025-08-25T13:49:26.313Z" } wheels = [ { url = "https://files.pythonhosted.org/packages/18/67/36e9267722cc04a6b9f15c7f3441c2363321a3ea07da7ae0c0707beb2a9c/typing_extensions-4.15.0-py3-none-any.whl", hash = "sha256:f0fa19c6845758ab08074a0cfa8b7aecb71c999ca73d62883bc25cc018c4e548", size = 44614, upload-time = "2025-08-25T13:49:24.86Z" }, @@ -295,7 +295,7 @@ wheels = [ [[package]] name = "urllib3" version = "2.6.3" -source = { registry = "https://pypi-proxy.dev.databricks.com/simple/" } +source = { registry = "https://pypi-proxy.cloud.databricks.com/simple/" } sdist = { url = "https://files.pythonhosted.org/packages/c7/24/5f1b3bdffd70275f6661c76461e25f024d5a38a46f04aaca912426a2b1d3/urllib3-2.6.3.tar.gz", hash = "sha256:1b62b6884944a57dbe321509ab94fd4d3b307075e0c2eae991ac71ee15ad38ed", size = 435556, upload-time = "2026-01-07T16:24:43.925Z" } wheels = [ { url = "https://files.pythonhosted.org/packages/39/08/aaaad47bc4e9dc8c725e68f9d04865dbcb2052843ff09c97b08904852d84/urllib3-2.6.3-py3-none-any.whl", hash = "sha256:bf272323e553dfb2e87d9bfd225ca7b0f467b919d7bbd355436d3fd37cb0acd4", size = 131584, upload-time = "2026-01-07T16:24:42.685Z" }, From b05691628d46ebde10c14605699e3d701fdf7cb5 Mon Sep 17 00:00:00 2001 From: Shreyas Goenka Date: Fri, 22 May 2026 10:12:19 +0000 Subject: [PATCH 7/7] acc: extend SCIM-Me redactor regex for the SDK v0.136 trailing `?` `CurrentUser.Me` in SDK v0.136 takes an `iam.MeRequest{}` argument; the URL builder appends an empty query separator, so the wire request is `.../Me?` instead of `.../Me`. Two acceptance tests redact the network error with a regex anchored on `Me": ` (no `?`), so the redaction misses and the goldens diverge. Update the regex in both `test.toml` files to accept an optional `?` (`Me\??":`). Backward-compatible with pre-bump URLs and forward-compatible if the SDK ever drops the trailing `?` again. Tested locally: both `TestAccept/auth/bundle_default_profile` and `TestAccept/auth/bundle_and_profile` pass. Co-authored-by: Isaac --- acceptance/auth/bundle_and_profile/test.toml | 2 +- acceptance/auth/bundle_default_profile/test.toml | 2 +- 2 files changed, 2 insertions(+), 2 deletions(-) diff --git a/acceptance/auth/bundle_and_profile/test.toml b/acceptance/auth/bundle_and_profile/test.toml index 92458e9d303..504b4c63eee 100644 --- a/acceptance/auth/bundle_and_profile/test.toml +++ b/acceptance/auth/bundle_and_profile/test.toml @@ -10,5 +10,5 @@ Old='DATABRICKS_URL' New='DATABRICKS_TARGET' [[Repls]] -Old='Get "https://non.existing.subdomain.databricks.com/api/2.0/preview/scim/v2/Me": .*' +Old='Get "https://non.existing.subdomain.databricks.com/api/2.0/preview/scim/v2/Me\??": .*' New='Get "https://non.existing.subdomain.databricks.com/api/2.0/preview/scim/v2/Me": (redacted)' diff --git a/acceptance/auth/bundle_default_profile/test.toml b/acceptance/auth/bundle_default_profile/test.toml index a1f31285b50..5d5b0283f42 100644 --- a/acceptance/auth/bundle_default_profile/test.toml +++ b/acceptance/auth/bundle_default_profile/test.toml @@ -7,5 +7,5 @@ Ignore = [ # Negative case: -p other tries to reach a non-existing host. Redact the # OS-/network-dependent suffix so the test is stable across runners. [[Repls]] -Old = 'Get "https://other.test/api/2.0/preview/scim/v2/Me": .*' +Old = 'Get "https://other.test/api/2.0/preview/scim/v2/Me\??": .*' New = 'Get "https://other.test/api/2.0/preview/scim/v2/Me": (redacted)'