Skip to content

Recover the deployment when its create response is lost - #7770

Merged
denik merged 3 commits into
mainfrom
dms-recover-created-deployment
Nov 18, 2026
Merged

denik merged 3 commits into
mainfrom
dms-recover-created-deployment

Conversation

@denik

@denik denik commented Nov 18, 2026 •

Copy link
Copy Markdown
Contributor

Changes

  • CreateDeployment can fail after the server has applied it: in CI the response body read fails with an HTTP/2 stream reset. In shadow mode the deploy then only warned and wrote its jobs without deployment.deployment_id. The next plan finds the deployment at ${workspace.state_path}/resources.deployment.json and stamps its id, so it reports update for every job. That is the no_drift failure.
  • Now, after any create error, the deploy looks the deployment up at the state path and uses it if its record exists and has no versions yet. A rejected create leaves no node, so no status classification is needed. A deployment with versions existed before this run, so it is not taken over. The lookup (node plus record) moved from cmd/bundle/utils to dms.FetchDeployment, so bundle/phases can share it.
  • The testserver's CreateDeployment now matches the service: a second create in the same folder fails with ALREADY_EXISTS (it used to overwrite the node with a new deployment), and a node with no record is finalized in place. As a result, bundle/dms_fault/get_deployment now shows the warning the cloud gives ("failed to create deployment: deployment [DEPLOYMENT_ID] already exists") where the fake used to register a replacement deployment silently.

Why

Read back rather than retry, following the deploy lock create in #7594: the service rejects a second create in the same folder.

Tests

  • New acceptance/bundle/dms/create-response-lost (local, fault.py --after-handler) has three cases:

    • a 500 after the create was applied is recovered;
    • a 503 the SDK retries into ALREADY_EXISTS is recovered;
    • an existing deployment with versions is not adopted.

    Without the fix, the recovered cases show the warning, then update jobs.foo / Plan: 0 to add, 1 to change.

  • bundle/ acceptance passes locally. no_drift/DMS=true ran on AWS in this PR's integration run: 87 passed, 0 failed (linux and windows).

  • The last commit asks CI to run aws: TestAccept/bundle/invariant/no_drift/DMS=true.

Dashboard

error verbatim snippet
error/3510 Warn: Could not enable deployment history for this deploy: failed to create deployment: response body: stream error: stream ID 99; INTERNAL_ERROR; received from peer ... Unexpected action='update' for resources.jobs.foo, "deployment.deployment_id": {"action": "update", ...}

Tests: TestAccept/bundle/invariant/no_drift/DMS=true/INPUT_CONFIG=job_table_update_trigger.yml.tmpl/READPLAN=1, TestAccept/bundle/invariant/no_drift/DMS=true/INPUT_CONFIG=job_escaped_refs.yml.tmpl/READPLAN=, TestAccept/bundle/invariant/no_drift/DMS=true/INPUT_CONFIG=job_permission_ref.yml.tmpl/READPLAN=1

This pull request and its description were written by Isaac.

When CreateDeployment fails after the server applied it (an HTTP/2 stream
reset while the body is read), the deploy wrote its jobs without
deployment_id, and the next plan, which finds the deployment at the state
path, reported them as changed. On any create error other than a 4xx, look
the deployment up at the state path and use it if it exists.

Also print the invariant tests' LOG.*.err files on failure: the "*.err"
ignore pattern hid them, so a failing `bundle plan` left only "Exit code: 1".

aws: TestAccept/bundle/invariant/no_drift/DMS=true

Co-authored-by: Isaac <no-reply@databricks.com>
@denik denik added the ai-auto Deprecated: use factory-generated instead. label Nov 18, 2026
@github-actions github-actions Bot added the DABs DABs related issues label Nov 18, 2026
@github-actions

github-actions Bot commented Nov 18, 2026 •

Copy link
Copy Markdown
Contributor

Commit: b37676763 | Workflow run

Regression test report

Selected 2 changed tests (limit=20, 0 not selected)

127 tests: regression=2 unreleased=0 coverage=125 failing=0
test branch main (61f1fc5) latest (v1.26.0)
TestAccept/bundle/dms/create-response-lost/DMS=true ✅ ❌ ❌
TestAccept/bundle/dms_fault/get_deployment/DMS=true ✅ ❌ ❌
TestAccept/bundle/invariant/no_drift/DMS=true/INPUT_CONFIG=alert.yml.tmpl/READPLAN= ✅ ✅ ✅
TestAccept/bundle/invariant/no_drift/DMS=true/INPUT_CONFIG=alert.yml.tmpl/READPLAN=1 ✅ ✅ ✅
TestAccept/bundle/invariant/no_drift/DMS=true/INPUT_CONFIG=app.yml.tmpl/READPLAN= ✅ ✅ ✅
TestAccept/bundle/invariant/no_drift/DMS=true/INPUT_CONFIG=app.yml.tmpl/READPLAN=1 ✅ ✅ ✅
TestAccept/bundle/invariant/no_drift/DMS=true/INPUT_CONFIG=catalog.yml.tmpl/READPLAN= ✅ ✅ ✅
TestAccept/bundle/invariant/no_drift/DMS=true/INPUT_CONFIG=catalog.yml.tmpl/READPLAN=1 ✅ ✅ ✅
TestAccept/bundle/invariant/no_drift/DMS=true/INPUT_CONFIG=catalog_optional_fields.yml.tmpl/READPLAN= ✅ ✅ ✅
TestAccept/bundle/invariant/no_drift/DMS=true/INPUT_CONFIG=catalog_optional_fields.yml.tmpl/READPLAN=1 ✅ ✅ ✅
TestAccept/bundle/invariant/no_drift/DMS=true/INPUT_CONFIG=cluster.yml.tmpl/READPLAN= ✅ ✅ ✅
TestAccept/bundle/invariant/no_drift/DMS=true/INPUT_CONFIG=cluster.yml.tmpl/READPLAN=1 ✅ ✅ ✅
TestAccept/bundle/invariant/no_drift/DMS=true/INPUT_CONFIG=cluster_apply_policy_default_values.yml.tmpl/READPLAN= ✅ ✅ ✅
TestAccept/bundle/invariant/no_drift/DMS=true/INPUT_CONFIG=cluster_apply_policy_default_values.yml.tmpl/READPLAN=1 ✅ ✅ ✅
TestAccept/bundle/invariant/no_drift/DMS=true/INPUT_CONFIG=cluster_libraries.yml.tmpl/READPLAN= ✅ ✅ ✅
TestAccept/bundle/invariant/no_drift/DMS=true/INPUT_CONFIG=cluster_libraries.yml.tmpl/READPLAN=1 ✅ ✅ ✅
TestAccept/bundle/invariant/no_drift/DMS=true/INPUT_CONFIG=cluster_policy.yml.tmpl/READPLAN= ✅ ✅ ✅
TestAccept/bundle/invariant/no_drift/DMS=true/INPUT_CONFIG=cluster_policy.yml.tmpl/READPLAN=1 ✅ ✅ ✅
TestAccept/bundle/invariant/no_drift/DMS=true/INPUT_CONFIG=dashboard.yml.tmpl/READPLAN= ✅ ✅ ✅
TestAccept/bundle/invariant/no_drift/DMS=true/INPUT_CONFIG=dashboard.yml.tmpl/READPLAN=1 ✅ ✅ ✅
TestAccept/bundle/invariant/no_drift/DMS=true/INPUT_CONFIG=data_quality_monitor.yml.tmpl/READPLAN= ✅ ✅ ✅
TestAccept/bundle/invariant/no_drift/DMS=true/INPUT_CONFIG=data_quality_monitor.yml.tmpl/READPLAN=1 ✅ ✅ ✅
TestAccept/bundle/invariant/no_drift/DMS=true/INPUT_CONFIG=database_catalog.yml.tmpl/READPLAN= ✅ ✅ ✅
TestAccept/bundle/invariant/no_drift/DMS=true/INPUT_CONFIG=database_catalog.yml.tmpl/READPLAN=1 ✅ ✅ ✅
TestAccept/bundle/invariant/no_drift/DMS=true/INPUT_CONFIG=database_instance.yml.tmpl/READPLAN= ✅ ✅ ✅
TestAccept/bundle/invariant/no_drift/DMS=true/INPUT_CONFIG=database_instance.yml.tmpl/READPLAN=1 ✅ ✅ ✅
TestAccept/bundle/invariant/no_drift/DMS=true/INPUT_CONFIG=experiment.yml.tmpl/READPLAN= ✅ ✅ ✅
TestAccept/bundle/invariant/no_drift/DMS=true/INPUT_CONFIG=experiment.yml.tmpl/READPLAN=1 ✅ ✅ ✅
TestAccept/bundle/invariant/no_drift/DMS=true/INPUT_CONFIG=external_location.yml.tmpl/READPLAN= ✅ ✅ ✅
TestAccept/bundle/invariant/no_drift/DMS=true/INPUT_CONFIG=external_location.yml.tmpl/READPLAN=1 ✅ ✅ ✅
TestAccept/bundle/invariant/no_drift/DMS=true/INPUT_CONFIG=feature.yml.tmpl/READPLAN= ✅ ✅ ✅
TestAccept/bundle/invariant/no_drift/DMS=true/INPUT_CONFIG=feature.yml.tmpl/READPLAN=1 ✅ ✅ ✅
TestAccept/bundle/invariant/no_drift/DMS=true/INPUT_CONFIG=genie_space.yml.tmpl/READPLAN= ✅ ✅ ✅
TestAccept/bundle/invariant/no_drift/DMS=true/INPUT_CONFIG=genie_space.yml.tmpl/READPLAN=1 ✅ ✅ ✅
TestAccept/bundle/invariant/no_drift/DMS=true/INPUT_CONFIG=instance_pool.yml.tmpl/READPLAN= ✅ ✅ ✅
TestAccept/bundle/invariant/no_drift/DMS=true/INPUT_CONFIG=instance_pool.yml.tmpl/READPLAN=1 ✅ ✅ ✅
TestAccept/bundle/invariant/no_drift/DMS=true/INPUT_CONFIG=job.yml.tmpl/READPLAN= ✅ ✅ ✅
TestAccept/bundle/invariant/no_drift/DMS=true/INPUT_CONFIG=job.yml.tmpl/READPLAN=1 ✅ ✅ ✅
TestAccept/bundle/invariant/no_drift/DMS=true/INPUT_CONFIG=job_apply_policy_default_values_for_each_task.yml.tmpl/READPLAN= ✅ ✅ ✅
TestAccept/bundle/invariant/no_drift/DMS=true/INPUT_CONFIG=job_apply_policy_default_values_for_each_task.yml.tmpl/READPLAN=1 ✅ ✅ ✅
TestAccept/bundle/invariant/no_drift/DMS=true/INPUT_CONFIG=job_apply_policy_default_values_job_cluster.yml.tmpl/READPLAN= ✅ ✅ ✅
TestAccept/bundle/invariant/no_drift/DMS=true/INPUT_CONFIG=job_apply_policy_default_values_job_cluster.yml.tmpl/READPLAN=1 ✅ ✅ ✅
TestAccept/bundle/invariant/no_drift/DMS=true/INPUT_CONFIG=job_apply_policy_default_values_task_cluster.yml.tmpl/READPLAN= ✅ ✅ ✅
TestAccept/bundle/invariant/no_drift/DMS=true/INPUT_CONFIG=job_apply_policy_default_values_task_cluster.yml.tmpl/READPLAN=1 ✅ ✅ ✅
TestAccept/bundle/invariant/no_drift/DMS=true/INPUT_CONFIG=job_cross_resource_ref.yml.tmpl/READPLAN= ✅ ✅ ✅
TestAccept/bundle/invariant/no_drift/DMS=true/INPUT_CONFIG=job_cross_resource_ref.yml.tmpl/READPLAN=1 ✅ ✅ ✅
TestAccept/bundle/invariant/no_drift/DMS=true/INPUT_CONFIG=job_escaped_refs.yml.tmpl/READPLAN= ✅ ✅ ✅
TestAccept/bundle/invariant/no_drift/DMS=true/INPUT_CONFIG=job_escaped_refs.yml.tmpl/READPLAN=1 ✅ ✅ ✅
TestAccept/bundle/invariant/no_drift/DMS=true/INPUT_CONFIG=job_permission_ref.yml.tmpl/READPLAN= ✅ ✅ ✅
TestAccept/bundle/invariant/no_drift/DMS=true/INPUT_CONFIG=job_permission_ref.yml.tmpl/READPLAN=1 ✅ ✅ ✅
TestAccept/bundle/invariant/no_drift/DMS=true/INPUT_CONFIG=job_pydabs_10_tasks.yml.tmpl/READPLAN= ✅ ✅ ✅
TestAccept/bundle/invariant/no_drift/DMS=true/INPUT_CONFIG=job_pydabs_10_tasks.yml.tmpl/READPLAN=1 ✅ ✅ ✅
TestAccept/bundle/invariant/no_drift/DMS=true/INPUT_CONFIG=job_run.yml.tmpl/READPLAN= ✅ ✅ ✅
TestAccept/bundle/invariant/no_drift/DMS=true/INPUT_CONFIG=job_run.yml.tmpl/READPLAN=1 ✅ ✅ ✅
TestAccept/bundle/invariant/no_drift/DMS=true/INPUT_CONFIG=job_run_job_ref.yml.tmpl/READPLAN= ✅ ✅ ✅
TestAccept/bundle/invariant/no_drift/DMS=true/INPUT_CONFIG=job_run_job_ref.yml.tmpl/READPLAN=1 ✅ ✅ ✅
TestAccept/bundle/invariant/no_drift/DMS=true/INPUT_CONFIG=job_table_update_trigger.yml.tmpl/READPLAN= ✅ ✅ ✅
TestAccept/bundle/invariant/no_drift/DMS=true/INPUT_CONFIG=job_table_update_trigger.yml.tmpl/READPLAN=1 ✅ ✅ ✅
TestAccept/bundle/invariant/no_drift/DMS=true/INPUT_CONFIG=job_with_depends_on.yml.tmpl/READPLAN= ✅ ✅ ✅
TestAccept/bundle/invariant/no_drift/DMS=true/INPUT_CONFIG=job_with_depends_on.yml.tmpl/READPLAN=1 ✅ ✅ ✅
TestAccept/bundle/invariant/no_drift/DMS=true/INPUT_CONFIG=job_with_task.yml.tmpl/READPLAN= ✅ ✅ ✅
TestAccept/bundle/invariant/no_drift/DMS=true/INPUT_CONFIG=job_with_task.yml.tmpl/READPLAN=1 ✅ ✅ ✅
TestAccept/bundle/invariant/no_drift/DMS=true/INPUT_CONFIG=model.yml.tmpl/READPLAN= ✅ ✅ ✅
TestAccept/bundle/invariant/no_drift/DMS=true/INPUT_CONFIG=model.yml.tmpl/READPLAN=1 ✅ ✅ ✅
TestAccept/bundle/invariant/no_drift/DMS=true/INPUT_CONFIG=model_service.yml.tmpl/READPLAN= ✅ ✅ ✅
TestAccept/bundle/invariant/no_drift/DMS=true/INPUT_CONFIG=model_service.yml.tmpl/READPLAN=1 ✅ ✅ ✅
TestAccept/bundle/invariant/no_drift/DMS=true/INPUT_CONFIG=model_serving_endpoint.yml.tmpl/READPLAN= ✅ ✅ ✅
TestAccept/bundle/invariant/no_drift/DMS=true/INPUT_CONFIG=model_serving_endpoint.yml.tmpl/READPLAN=1 ✅ ✅ ✅
TestAccept/bundle/invariant/no_drift/DMS=true/INPUT_CONFIG=model_serving_endpoint_telemetry.yml.tmpl/READPLAN= ✅ ✅ ✅
TestAccept/bundle/invariant/no_drift/DMS=true/INPUT_CONFIG=model_serving_endpoint_telemetry.yml.tmpl/READPLAN=1 ✅ ✅ ✅
TestAccept/bundle/invariant/no_drift/DMS=true/INPUT_CONFIG=model_with_permissions.yml.tmpl/READPLAN= ✅ ✅ ✅
TestAccept/bundle/invariant/no_drift/DMS=true/INPUT_CONFIG=model_with_permissions.yml.tmpl/READPLAN=1 ✅ ✅ ✅
TestAccept/bundle/invariant/no_drift/DMS=true/INPUT_CONFIG=pipeline.yml.tmpl/READPLAN= ✅ ✅ ✅
TestAccept/bundle/invariant/no_drift/DMS=true/INPUT_CONFIG=pipeline.yml.tmpl/READPLAN=1 ✅ ✅ ✅
TestAccept/bundle/invariant/no_drift/DMS=true/INPUT_CONFIG=pipeline_allow_duplicate_names.yml.tmpl/READPLAN= ✅ ✅ ✅
TestAccept/bundle/invariant/no_drift/DMS=true/INPUT_CONFIG=pipeline_allow_duplicate_names.yml.tmpl/READPLAN=1 ✅ ✅ ✅
TestAccept/bundle/invariant/no_drift/DMS=true/INPUT_CONFIG=pipeline_apply_policy_default_values.yml.tmpl/READPLAN= ✅ ✅ ✅
TestAccept/bundle/invariant/no_drift/DMS=true/INPUT_CONFIG=pipeline_apply_policy_default_values.yml.tmpl/READPLAN=1 ✅ ✅ ✅
TestAccept/bundle/invariant/no_drift/DMS=true/INPUT_CONFIG=pipeline_config_dots.yml.tmpl/READPLAN= ✅ ✅ ✅
TestAccept/bundle/invariant/no_drift/DMS=true/INPUT_CONFIG=pipeline_config_dots.yml.tmpl/READPLAN=1 ✅ ✅ ✅
TestAccept/bundle/invariant/no_drift/DMS=true/INPUT_CONFIG=postgres_branch.yml.tmpl/READPLAN= ✅ ✅ ✅
TestAccept/bundle/invariant/no_drift/DMS=true/INPUT_CONFIG=postgres_branch.yml.tmpl/READPLAN=1 ✅ ✅ ✅
TestAccept/bundle/invariant/no_drift/DMS=true/INPUT_CONFIG=postgres_catalog.yml.tmpl/READPLAN= ✅ ✅ ✅
TestAccept/bundle/invariant/no_drift/DMS=true/INPUT_CONFIG=postgres_catalog.yml.tmpl/READPLAN=1 ✅ ✅ ✅
TestAccept/bundle/invariant/no_drift/DMS=true/INPUT_CONFIG=postgres_database.yml.tmpl/READPLAN= ✅ ✅ ✅
TestAccept/bundle/invariant/no_drift/DMS=true/INPUT_CONFIG=postgres_database.yml.tmpl/READPLAN=1 ✅ ✅ ✅
TestAccept/bundle/invariant/no_drift/DMS=true/INPUT_CONFIG=postgres_endpoint.yml.tmpl/READPLAN= ✅ ✅ ✅
TestAccept/bundle/invariant/no_drift/DMS=true/INPUT_CONFIG=postgres_endpoint.yml.tmpl/READPLAN=1 ✅ ✅ ✅
TestAccept/bundle/invariant/no_drift/DMS=true/INPUT_CONFIG=postgres_project.yml.tmpl/READPLAN= ✅ ✅ ✅
TestAccept/bundle/invariant/no_drift/DMS=true/INPUT_CONFIG=postgres_project.yml.tmpl/READPLAN=1 ✅ ✅ ✅
TestAccept/bundle/invariant/no_drift/DMS=true/INPUT_CONFIG=postgres_role.yml.tmpl/READPLAN= ✅ ✅ ✅
TestAccept/bundle/invariant/no_drift/DMS=true/INPUT_CONFIG=postgres_role.yml.tmpl/READPLAN=1 ✅ ✅ ✅
TestAccept/bundle/invariant/no_drift/DMS=true/INPUT_CONFIG=postgres_synced_table.yml.tmpl/READPLAN= ✅ ✅ ✅
TestAccept/bundle/invariant/no_drift/DMS=true/INPUT_CONFIG=postgres_synced_table.yml.tmpl/READPLAN=1 ✅ ✅ ✅
TestAccept/bundle/invariant/no_drift/DMS=true/INPUT_CONFIG=registered_model.yml.tmpl/READPLAN= ✅ ✅ ✅
TestAccept/bundle/invariant/no_drift/DMS=true/INPUT_CONFIG=registered_model.yml.tmpl/READPLAN=1 ✅ ✅ ✅
TestAccept/bundle/invariant/no_drift/DMS=true/INPUT_CONFIG=schema.yml.tmpl/READPLAN= ✅ ✅ ✅
TestAccept/bundle/invariant/no_drift/DMS=true/INPUT_CONFIG=schema.yml.tmpl/READPLAN=1 ✅ ✅ ✅
TestAccept/bundle/invariant/no_drift/DMS=true/INPUT_CONFIG=schema_grant_ref.yml.tmpl/READPLAN= ✅ ✅ ✅
TestAccept/bundle/invariant/no_drift/DMS=true/INPUT_CONFIG=schema_grant_ref.yml.tmpl/READPLAN=1 ✅ ✅ ✅
TestAccept/bundle/invariant/no_drift/DMS=true/INPUT_CONFIG=schema_tf_compat.yml.tmpl/READPLAN= ✅ ✅ ✅
TestAccept/bundle/invariant/no_drift/DMS=true/INPUT_CONFIG=schema_tf_compat.yml.tmpl/READPLAN=1 ✅ ✅ ✅
TestAccept/bundle/invariant/no_drift/DMS=true/INPUT_CONFIG=schema_uppercase_name.yml.tmpl/READPLAN= ✅ ✅ ✅
TestAccept/bundle/invariant/no_drift/DMS=true/INPUT_CONFIG=schema_uppercase_name.yml.tmpl/READPLAN=1 ✅ ✅ ✅
TestAccept/bundle/invariant/no_drift/DMS=true/INPUT_CONFIG=secret.yml.tmpl/READPLAN= ✅ ✅ ✅
TestAccept/bundle/invariant/no_drift/DMS=true/INPUT_CONFIG=secret_scope.yml.tmpl/READPLAN= ✅ ✅ ✅
TestAccept/bundle/invariant/no_drift/DMS=true/INPUT_CONFIG=secret_scope.yml.tmpl/READPLAN=1 ✅ ✅ ✅
TestAccept/bundle/invariant/no_drift/DMS=true/INPUT_CONFIG=secret_scope_default_backend_type.yml.tmpl/READPLAN= ✅ ✅ ✅
TestAccept/bundle/invariant/no_drift/DMS=true/INPUT_CONFIG=secret_scope_default_backend_type.yml.tmpl/READPLAN=1 ✅ ✅ ✅
TestAccept/bundle/invariant/no_drift/DMS=true/INPUT_CONFIG=sql_warehouse.yml.tmpl/READPLAN= ✅ ✅ ✅
TestAccept/bundle/invariant/no_drift/DMS=true/INPUT_CONFIG=sql_warehouse.yml.tmpl/READPLAN=1 ✅ ✅ ✅
TestAccept/bundle/invariant/no_drift/DMS=true/INPUT_CONFIG=synced_database_table.yml.tmpl/READPLAN= ✅ ✅ ✅
TestAccept/bundle/invariant/no_drift/DMS=true/INPUT_CONFIG=synced_database_table.yml.tmpl/READPLAN=1 ✅ ✅ ✅
TestAccept/bundle/invariant/no_drift/DMS=true/INPUT_CONFIG=uc_trailing_slash.yml.tmpl/READPLAN= ✅ ✅ ✅
TestAccept/bundle/invariant/no_drift/DMS=true/INPUT_CONFIG=uc_trailing_slash.yml.tmpl/READPLAN=1 ✅ ✅ ✅
TestAccept/bundle/invariant/no_drift/DMS=true/INPUT_CONFIG=vector_search_endpoint.yml.tmpl/READPLAN= ✅ ✅ ✅
TestAccept/bundle/invariant/no_drift/DMS=true/INPUT_CONFIG=vector_search_endpoint.yml.tmpl/READPLAN=1 ✅ ✅ ✅
TestAccept/bundle/invariant/no_drift/DMS=true/INPUT_CONFIG=vector_search_index.yml.tmpl/READPLAN= ✅ ✅ ✅
TestAccept/bundle/invariant/no_drift/DMS=true/INPUT_CONFIG=vector_search_index.yml.tmpl/READPLAN=1 ✅ ✅ ✅
TestAccept/bundle/invariant/no_drift/DMS=true/INPUT_CONFIG=volume.yml.tmpl/READPLAN= ✅ ✅ ✅
TestAccept/bundle/invariant/no_drift/DMS=true/INPUT_CONFIG=volume.yml.tmpl/READPLAN=1 ✅ ✅ ✅
TestAccept/bundle/invariant/no_drift/DMS=true/INPUT_CONFIG=volume_external.yml.tmpl/READPLAN= ✅ ✅ ✅
TestAccept/bundle/invariant/no_drift/DMS=true/INPUT_CONFIG=volume_external.yml.tmpl/READPLAN=1 ✅ ✅ ✅
TestAccept/bundle/invariant/no_drift/DMS=true/INPUT_CONFIG=volume_path_job_ref.yml.tmpl/READPLAN= ✅ ✅ ✅
TestAccept/bundle/invariant/no_drift/DMS=true/INPUT_CONFIG=volume_path_job_ref.yml.tmpl/READPLAN=1 ✅ ✅ ✅
TestAccept/bundle/invariant/no_drift/DMS=true/INPUT_CONFIG=volume_uppercase_name.yml.tmpl/READPLAN= ✅ ✅ ✅
TestAccept/bundle/invariant/no_drift/DMS=true/INPUT_CONFIG=volume_uppercase_name.yml.tmpl/READPLAN=1 ✅ ✅ ✅
TestAccept/bundle/dms/create-response-lost/DMS=true: branch ✅ | main (61f1fc5) ❌ | latest (v1.26.0) ❌

main (61f1fc5):

acceptance_test.go:1334: Suppressed from output.txt:
        Warn: retrying after 500 Internal Server Error from GET /api/2.0/bundle/deployments/[DEPLOYMENT_ID]
        Warn: retrying after 500 Internal Server Error from GET /api/2.0/bundle/deployments/[DEPLOYMENT_ID]
    acceptance_test.go:1388: Diff:
        --- bundle/dms/create-response-lost/output.txt
        +++ /tmp/TestAcceptbundledmscreate-response-lostDMS=true2951661364/002/output.txt
        @@ -5,6 +5,7 @@
         
         >>> [CLI] bundle deploy
         Uploading bundle files to /Workspace/Users/[USERNAME]/.bundle/dms-create-response-lost-[UNIQUE_NAME]/default/files...
        +Warn: Could not enable deployment history for this deploy: failed to create deployment: Fault injected by test.
         Created jobs.foo
         Files: 2 uploaded, 0 deleted
         Resources: 1 created, 0 changed, 0 deleted, 0 unchanged
        @@ -13,7 +14,6 @@
         
         >>> [CLI] jobs get [JOB_ID]
         {
        -  "deployment_id": "[DEPLOYMENT_ID]",
           "kind": "BUNDLE",
           "metadata_file_path": "/Workspace/Users/[USERNAME]/.bundle/dms-create-response-lost-[UNIQUE_NAME]/default/state/metadata.json",
           "version_id": "1"
        @@ -22,8 +22,10 @@
         === No drift after the deploy
         
         >>> [CLI] bundle plan
        -Plan: 0 to add, 0 to change, 0 to delete, 1 unchanged
        +update jobs.foo
         
        +Plan: 0 to add, 1 to change, 0 to delete, 0 unchanged
        +
         === A create that finds an earlier deployment with versions does not adopt it
         
         >>> fault.py GET /api/2.0/bundle/deployments/* 500 0 3
        @@ -32,9 +33,8 @@
         Warn: Could not read deployment history: Fault injected by test.
         Uploading bundle files to /Workspace/Users/[USERNAME]/.bundle/dms-create-response-lost-[UNIQUE_NAME]/default/files...
         Warn: Could not enable deployment history for this deploy: failed to create deployment: deployment [DEPLOYMENT_ID] already exists
        -Updated jobs.foo
         Files: 0 uploaded, 0 deleted
        -Resources: 0 created, 1 changed, 0 deleted, 0 unchanged
        +Resources: 0 created, 0 changed, 0 deleted, 1 unchanged
         
         === Destroy, so the next deploy creates a new deployment
         
        @@ -52,17 +51,19 @@
         
         >>> [CLI] bundle deploy
         Uploading bundle files to /Workspace/Users/[USERNAME]/.bundle/dms-create-response-lost-[UNIQUE_NAME]/default/files...
        +Warn: Could not enable deployment history for this deploy: failed to create deployment: deployment [DEPLOYMENT_ID_2] already exists
         Created jobs.foo
         Files: 2 uploaded, 0 deleted
         Resources: 1 created, 0 changed, 0 deleted, 0 unchanged
         
         >>> [CLI] jobs get [JOB_ID_2]
         {
        -  "deployment_id": "[DEPLOYMENT_ID_2]",
           "kind": "BUNDLE",
           "metadata_file_path": "/Workspace/Users/[USERNAME]/.bundle/dms-create-response-lost-[UNIQUE_NAME]/default/state/metadata.json",
           "version_id": "1"
         }
         
         >>> [CLI] bundle plan
        -Plan: 0 to add, 0 to change, 0 to delete, 1 unchanged
        +update jobs.foo
        +
        +Plan: 0 to add, 1 to change, 0 to delete, 0 unchanged

latest (v1.26.0): same output as main (61f1fc5)

TestAccept/bundle/dms_fault/get_deployment/DMS=true: branch ✅ | main (61f1fc5) ❌ | latest (v1.26.0) ❌

main (61f1fc5):

acceptance_test.go:1388: Diff:
        --- bundle/dms_fault/get_deployment/output.txt
        +++ /tmp/TestAcceptbundledms_faultget_deploymentDMS=true1333681819/002/output.txt
        @@ -16,8 +16,6 @@
           Warn: retrying after 500 Internal Server Error from GET /api/2.0/bundle/deployments/[DEPLOYMENT_ID]
           Warn: Could not read deployment history: Fault injected by test.
           Uploading bundle files to /Workspace/Users/[USERNAME]/.bundle/dms-fault-get_deployment-commands-[UNIQUE_NAME]/files...
        -  Warn: retrying after 500 Internal Server Error from GET /api/2.0/bundle/deployments/[DEPLOYMENT_ID]
        -  Warn: retrying after 500 Internal Server Error from GET /api/2.0/bundle/deployments/[DEPLOYMENT_ID]
           Warn: Could not enable deployment history for this deploy: failed to create deployment: deployment [DEPLOYMENT_ID] already exists
           Updated jobs.foo
           Updated pipelines.bar
        @@ -93,8 +91,6 @@
           Warn: retrying after 500 Internal Server Error from GET /api/2.0/bundle/deployments/[DEPLOYMENT_ID]
           Warn: Could not read deployment history: Fault injected by test.
           Uploading bundle files to /Workspace/Users/[USERNAME]/.bundle/dms-fault-get_deployment-commands-[UNIQUE_NAME]/files...
        -  Warn: retrying after 500 Internal Server Error from GET /api/2.0/bundle/deployments/[DEPLOYMENT_ID]
        -  Warn: retrying after 500 Internal Server Error from GET /api/2.0/bundle/deployments/[DEPLOYMENT_ID]
           Warn: Could not enable deployment history for this deploy: failed to create deployment: deployment [DEPLOYMENT_ID] already exists
           Updated pipelines.bar
           Files: 6 uploaded, 0 deleted
        @@ -115,8 +111,6 @@
           Warn: retrying after 500 Internal Server Error from GET /api/2.0/bundle/deployments/[DEPLOYMENT_ID]
           Warn: Could not read deployment history: Fault injected by test.
           Uploading bundle files to /Workspace/Users/[USERNAME]/.bundle/dms-fault-get_deployment-commands-[UNIQUE_NAME]/files...
        -  Warn: retrying after 500 Internal Server Error from GET /api/2.0/bundle/deployments/[DEPLOYMENT_ID]
        -  Warn: retrying after 500 Internal Server Error from GET /api/2.0/bundle/deployments/[DEPLOYMENT_ID]
           Warn: Could not enable deployment history for this deploy: failed to create deployment: deployment [DEPLOYMENT_ID] already exists
           Updated jobs.foo
           Files: 2 uploaded, 0 deleted
        @@ -136,8 +130,6 @@
         
           All files and directories at the following location will be deleted: /Workspace/Users/[USERNAME]/.bundle/dms-fault-get_deployment-commands-[UNIQUE_NAME]
         
        -  Warn: retrying after 500 Internal Server Error from GET /api/2.0/bundle/deployments/[DEPLOYMENT_ID]
        -  Warn: retrying after 500 Internal Server Error from GET /api/2.0/bundle/deployments/[DEPLOYMENT_ID]
           Warn: Could not record deployment history for this destroy: failed to create deployment: deployment [DEPLOYMENT_ID] already exists
           Destroy: 2 deleted
         
        
    acceptance_test.go:1166: 
        LOG.commands: 
        LOG.commands: commands: ('bundle', 'deploy', '--auto-approve')
        LOG.commands: exit=0
        LOG.commands: Uploading bundle files to /Workspace/Users/tester@databricks.com/.bundle/dms-fault-get_deployment-commands-l5aqcv6brbh3faity73pxqecpq/files...
        LOG.commands: Current Deployment Version: http://127.0.0.1:35853/deployments/4000000000000077?version=1
        LOG.commands: Created pipelines.bar
        LOG.commands: Created jobs.foo
        LOG.commands: Files: 4 uploaded, 0 deleted
        LOG.commands: Resources: 2 created, 0 changed, 0 deleted, 0 unchanged
        LOG.commands: 
        LOG.commands: commands: ('workspace', 'get-status', '/Workspace/Users/tester@databricks.com/.bundle/dms-fault-get_deployment-commands-l5aqcv6brbh3faity73pxqecpq/state/resources.deployment.json', '-o', 'json')
        LOG.commands: exit=0
        LOG.commands: {
        LOG.commands:   "object_id": 4000000000000077,
        LOG.commands:   "object_type": "BUNDLE_DEPLOYMENT",
        LOG.commands:   "path": "/Workspace/Users/tester@databricks.com/.bundle/dms-fault-get_deployment-commands-l5aqcv6brbh3faity73pxqecpq/state/resources.deployment.json"
        LOG.commands: }
        LOG.commands: 
        LOG.commands: commands: ('bundle', 'deploy', '--auto-approve')
        LOG.commands: exit=0
        LOG.commands: Warn: retrying after 500 Internal Server Error from GET /api/2.0/bundle/deployments/4000000000000077
        LOG.commands: Warn: retrying after 500 Internal Server Error from GET /api/2.0/bundle/deployments/4000000000000077
        LOG.commands: Warn: Could not read deployment history: Fault injected by test.
        LOG.commands: Uploading bundle files to /Workspace/Users/tester@databricks.com/.bundle/dms-fault-get_deployment-commands-l5aqcv6brbh3faity73pxqecpq/files...
        LOG.commands: Warn: Could not enable deployment history for this deploy: failed to create deployment: deployment 4000000000000077 already exists
        LOG.commands: Updated pipelines.bar
        LOG.commands: Updated jobs.foo
        LOG.commands: Files: 3 uploaded, 0 deleted
        LOG.commands: Resources: 0 created, 2 changed, 0 deleted, 0 unchanged
        LOG.commands: 
        LOG.commands: commands: ('jobs', 'get', '8795020625136168499', '-o', 'json')
        LOG.commands: exit=0
        LOG.commands: {
        LOG.commands:   "created_time": 1795020625136,
        LOG.commands:   "creator_user_name": "tester@databricks.com",
        LOG.commands:   "job_id": 8795020625136168499,
        LOG.commands:   "run_as_user_name": "tester@databricks.com",
        LOG.commands:   "settings": {
        LOG.commands:     "deployment": {
        LOG.commands:       "kind": "BUNDLE",
        LOG.commands:       "metadata_file_path": "/Workspace/Users/tester@databricks.com/.bundle/dms-fault-get_deployment-commands-l5aqcv6brbh3faity73pxqecpq/state/metadata.json"
        LOG.commands:     },
        LOG.commands:     "description": "history-true",
        LOG.commands:     "edit_mode": "UI_LOCKED",
        LOG.commands:     "email_notifications": {},
        LOG.commands:     "format": "MULTI_TASK",
        LOG.commands:     "max_concurrent_runs": 1,
        LOG.commands:     "name": "updated-dms-fault-get_deployment-commands-l5aqcv6brbh3faity73pxqecpq",
        LOG.commands:     "queue": {
        LOG.commands:       "enabled": true
        LOG.commands:     },
        LOG.commands:     "timeout_seconds": 0,
        LOG.commands:     "webhook_notifications": {}
        LOG.commands:   }
        LOG.commands: }
        LOG.commands: 
        LOG.commands: commands: ('pipelines', 'get', '7a0e30a9-1962-eddb-7a0e-30a91962eee9', '-o', 'json')
        LOG.commands: exit=0
        LOG.commands: {
        LOG.commands:   "creator_user_name": "tester@databricks.com",
        LOG.commands:   "effective_publishing_mode": "DEFAULT_PUBLISHING_MODE",
        LOG.commands:   "last_modified": 1795020625134,
        LOG.commands:   "name": "updated-dms-fault-get_deployment-commands-l5aqcv6brbh3faity73pxqecpq",
        LOG.commands:   "pipeline_id": "7a0e30a9-1962-eddb-7a0e-30a91962eee9",
        LOG.commands:   "run_as_user_name": "tester@databricks.com",
        LOG.commands:   "spec": {
        LOG.commands:     "catalog": "main",
        LOG.commands:     "channel": "CURRENT",
        LOG.commands:     "deployment": {
        LOG.commands:       "kind": "BUNDLE",
        LOG.commands:       "metadata_file_path": "/Workspace/Users/tester@databricks.com/.bundle/dms-fault-get_deployment-commands-l5aqcv6brbh3faity73pxqecpq/state/metadata.json"
        LOG.commands:     },
        LOG.commands:     "edition": "ADVANCED",
        LOG.commands:     "id": "7a0e30a9-1962-eddb-7a0e-30a91962eee9",
        LOG.commands:     "libraries": [
        LOG.commands:       {
        LOG.commands:         "file": {
        LOG.commands:           "path": "/Workspace/Users/tester@databricks.com/.bundle/dms-fault-get_deployment-commands-l5aqcv6brbh3faity73pxqecpq/files/pipeline.sql"
        LOG.commands:         }
        LOG.commands:       }
        LOG.commands:     ],
        LOG.commands:     "name": "updated-dms-fault-get_deployment-commands-l5aqcv6brbh3faity73pxqecpq",
        LOG.commands:     "schema": "default",
        LOG.commands:     "serverless": true
        LOG.commands:   },
        LOG.commands:   "state": "IDLE"
        LOG.commands: }
        LOG.commands: 
        LOG.commands: commands: ('bundle', 'summary')
        LOG.commands: exit=0
        LOG.commands: Warn: retrying after 500 Internal Server Error from GET /api/2.0/bundle/deployments/4000000000000077
        LOG.commands: Warn: retrying after 500 Internal Server Error from GET /api/2.0/bundle/deployments/4000000000000077
        LOG.commands: Warn: Could not read deployment history: Fault injected by test.
        LOG.commands: Name: updated-dms-fault-get_deployment-commands-l5aqcv6brbh3faity73pxqecpq
        LOG.commands: Target: default
        LOG.commands: Workspace:
        LOG.commands:   User: tester@databricks.com
        LOG.commands:   Path: /Workspace/Users/tester@databricks.com/.bundle/dms-fault-get_deployment-commands-l5aqcv6brbh3faity73pxqecpq
        LOG.commands: Resources:
        LOG.commands:   Jobs:
        LOG.commands: ... (358 more lines truncated, raise DATABRICKS_CLI_TEST_MAX_LOG to see more)

latest (v1.26.0):

acceptance_test.go:1388: Diff:
        --- bundle/dms_fault/get_deployment/output.txt
        +++ /tmp/TestAcceptbundledms_faultget_deploymentDMS=true228549528/002/output.txt
        @@ -16,8 +16,6 @@
           Warn: retrying after 500 Internal Server Error from GET /api/2.0/bundle/deployments/[DEPLOYMENT_ID]
           Warn: Could not read deployment history: Fault injected by test.
           Uploading bundle files to /Workspace/Users/[USERNAME]/.bundle/dms-fault-get_deployment-commands-[UNIQUE_NAME]/files...
        -  Warn: retrying after 500 Internal Server Error from GET /api/2.0/bundle/deployments/[DEPLOYMENT_ID]
        -  Warn: retrying after 500 Internal Server Error from GET /api/2.0/bundle/deployments/[DEPLOYMENT_ID]
           Warn: Could not enable deployment history for this deploy: failed to create deployment: deployment [DEPLOYMENT_ID] already exists
           Updated jobs.foo
           Updated pipelines.bar
        @@ -93,8 +91,6 @@
           Warn: retrying after 500 Internal Server Error from GET /api/2.0/bundle/deployments/[DEPLOYMENT_ID]
           Warn: Could not read deployment history: Fault injected by test.
           Uploading bundle files to /Workspace/Users/[USERNAME]/.bundle/dms-fault-get_deployment-commands-[UNIQUE_NAME]/files...
        -  Warn: retrying after 500 Internal Server Error from GET /api/2.0/bundle/deployments/[DEPLOYMENT_ID]
        -  Warn: retrying after 500 Internal Server Error from GET /api/2.0/bundle/deployments/[DEPLOYMENT_ID]
           Warn: Could not enable deployment history for this deploy: failed to create deployment: deployment [DEPLOYMENT_ID] already exists
           Updated pipelines.bar
           Files: 6 uploaded, 0 deleted
        @@ -115,8 +111,6 @@
           Warn: retrying after 500 Internal Server Error from GET /api/2.0/bundle/deployments/[DEPLOYMENT_ID]
           Warn: Could not read deployment history: Fault injected by test.
           Uploading bundle files to /Workspace/Users/[USERNAME]/.bundle/dms-fault-get_deployment-commands-[UNIQUE_NAME]/files...
        -  Warn: retrying after 500 Internal Server Error from GET /api/2.0/bundle/deployments/[DEPLOYMENT_ID]
        -  Warn: retrying after 500 Internal Server Error from GET /api/2.0/bundle/deployments/[DEPLOYMENT_ID]
           Warn: Could not enable deployment history for this deploy: failed to create deployment: deployment [DEPLOYMENT_ID] already exists
           Updated jobs.foo
           Files: 2 uploaded, 0 deleted
        @@ -136,8 +130,6 @@
         
           All files and directories at the following location will be deleted: /Workspace/Users/[USERNAME]/.bundle/dms-fault-get_deployment-commands-[UNIQUE_NAME]
         
        -  Warn: retrying after 500 Internal Server Error from GET /api/2.0/bundle/deployments/[DEPLOYMENT_ID]
        -  Warn: retrying after 500 Internal Server Error from GET /api/2.0/bundle/deployments/[DEPLOYMENT_ID]
           Warn: Could not record deployment history for this destroy: failed to create deployment: deployment [DEPLOYMENT_ID] already exists
           Destroy: 2 deleted
         
        
    acceptance_test.go:1166: 
        LOG.commands: 
        LOG.commands: commands: ('bundle', 'deploy', '--auto-approve')
        LOG.commands: exit=0
        LOG.commands: Uploading bundle files to /Workspace/Users/tester@databricks.com/.bundle/dms-fault-get_deployment-commands-ofidkxsgzrbtzcdz2d5ya5noaq/files...
        LOG.commands: Current Deployment Version: http://127.0.0.1:45735/deployments/4000000000000021?version=1
        LOG.commands: Created jobs.foo
        LOG.commands: Created pipelines.bar
        LOG.commands: Files: 4 uploaded, 0 deleted
        LOG.commands: Resources: 2 created, 0 changed, 0 deleted, 0 unchanged
        LOG.commands: 
        LOG.commands: commands: ('workspace', 'get-status', '/Workspace/Users/tester@databricks.com/.bundle/dms-fault-get_deployment-commands-ofidkxsgzrbtzcdz2d5ya5noaq/state/resources.deployment.json', '-o', 'json')
        LOG.commands: exit=0
        LOG.commands: {
        LOG.commands:   "object_id": 4000000000000021,
        LOG.commands:   "object_type": "BUNDLE_DEPLOYMENT",
        LOG.commands:   "path": "/Workspace/Users/tester@databricks.com/.bundle/dms-fault-get_deployment-commands-ofidkxsgzrbtzcdz2d5ya5noaq/state/resources.deployment.json"
        LOG.commands: }
        LOG.commands: 
        LOG.commands: commands: ('bundle', 'deploy', '--auto-approve')
        LOG.commands: exit=0
        LOG.commands: Warn: retrying after 500 Internal Server Error from GET /api/2.0/bundle/deployments/4000000000000021
        LOG.commands: Warn: retrying after 500 Internal Server Error from GET /api/2.0/bundle/deployments/4000000000000021
        LOG.commands: Warn: Could not read deployment history: Fault injected by test.
        LOG.commands: Uploading bundle files to /Workspace/Users/tester@databricks.com/.bundle/dms-fault-get_deployment-commands-ofidkxsgzrbtzcdz2d5ya5noaq/files...
        LOG.commands: Warn: Could not enable deployment history for this deploy: failed to create deployment: deployment 4000000000000021 already exists
        LOG.commands: Updated jobs.foo
        LOG.commands: Updated pipelines.bar
        LOG.commands: Files: 3 uploaded, 0 deleted
        LOG.commands: Resources: 0 created, 2 changed, 0 deleted, 0 unchanged
        LOG.commands: 
        LOG.commands: commands: ('jobs', 'get', '8795020675387518319', '-o', 'json')
        LOG.commands: exit=0
        LOG.commands: {
        LOG.commands:   "created_time": 1795020675387,
        LOG.commands:   "creator_user_name": "tester@databricks.com",
        LOG.commands:   "job_id": 8795020675387518319,
        LOG.commands:   "run_as_user_name": "tester@databricks.com",
        LOG.commands:   "settings": {
        LOG.commands:     "deployment": {
        LOG.commands:       "kind": "BUNDLE",
        LOG.commands:       "metadata_file_path": "/Workspace/Users/tester@databricks.com/.bundle/dms-fault-get_deployment-commands-ofidkxsgzrbtzcdz2d5ya5noaq/state/metadata.json"
        LOG.commands:     },
        LOG.commands:     "description": "history-true",
        LOG.commands:     "edit_mode": "UI_LOCKED",
        LOG.commands:     "email_notifications": {},
        LOG.commands:     "format": "MULTI_TASK",
        LOG.commands:     "max_concurrent_runs": 1,
        LOG.commands:     "name": "updated-dms-fault-get_deployment-commands-ofidkxsgzrbtzcdz2d5ya5noaq",
        LOG.commands:     "queue": {
        LOG.commands:       "enabled": true
        LOG.commands:     },
        LOG.commands:     "timeout_seconds": 0,
        LOG.commands:     "webhook_notifications": {}
        LOG.commands:   }
        LOG.commands: }
        LOG.commands: 
        LOG.commands: commands: ('pipelines', 'get', '7a0e30b4-ccc7-c285-7a0e-30b4ccc7c31b', '-o', 'json')
        LOG.commands: exit=0
        LOG.commands: {
        LOG.commands:   "creator_user_name": "tester@databricks.com",
        LOG.commands:   "effective_publishing_mode": "DEFAULT_PUBLISHING_MODE",
        LOG.commands:   "last_modified": 1795020675389,
        LOG.commands:   "name": "updated-dms-fault-get_deployment-commands-ofidkxsgzrbtzcdz2d5ya5noaq",
        LOG.commands:   "pipeline_id": "7a0e30b4-ccc7-c285-7a0e-30b4ccc7c31b",
        LOG.commands:   "run_as_user_name": "tester@databricks.com",
        LOG.commands:   "spec": {
        LOG.commands:     "catalog": "main",
        LOG.commands:     "channel": "CURRENT",
        LOG.commands:     "deployment": {
        LOG.commands:       "kind": "BUNDLE",
        LOG.commands:       "metadata_file_path": "/Workspace/Users/tester@databricks.com/.bundle/dms-fault-get_deployment-commands-ofidkxsgzrbtzcdz2d5ya5noaq/state/metadata.json"
        LOG.commands:     },
        LOG.commands:     "edition": "ADVANCED",
        LOG.commands:     "id": "7a0e30b4-ccc7-c285-7a0e-30b4ccc7c31b",
        LOG.commands:     "libraries": [
        LOG.commands:       {
        LOG.commands:         "file": {
        LOG.commands:           "path": "/Workspace/Users/tester@databricks.com/.bundle/dms-fault-get_deployment-commands-ofidkxsgzrbtzcdz2d5ya5noaq/files/pipeline.sql"
        LOG.commands:         }
        LOG.commands:       }
        LOG.commands:     ],
        LOG.commands:     "name": "updated-dms-fault-get_deployment-commands-ofidkxsgzrbtzcdz2d5ya5noaq",
        LOG.commands:     "schema": "default",
        LOG.commands:     "serverless": true
        LOG.commands:   },
        LOG.commands:   "state": "IDLE"
        LOG.commands: }
        LOG.commands: 
        LOG.commands: commands: ('bundle', 'summary')
        LOG.commands: exit=0
        LOG.commands: Warn: retrying after 500 Internal Server Error from GET /api/2.0/bundle/deployments/4000000000000021
        LOG.commands: Warn: retrying after 500 Internal Server Error from GET /api/2.0/bundle/deployments/4000000000000021
        LOG.commands: Warn: Could not read deployment history: Fault injected by test.
        LOG.commands: Name: updated-dms-fault-get_deployment-commands-ofidkxsgzrbtzcdz2d5ya5noaq
        LOG.commands: Target: default
        LOG.commands: Workspace:
        LOG.commands:   User: tester@databricks.com
        LOG.commands:   Path: /Workspace/Users/tester@databricks.com/.bundle/dms-fault-get_deployment-commands-ofidkxsgzrbtzcdz2d5ya5noaq
        LOG.commands: Resources:
        LOG.commands:   Jobs:
        LOG.commands: ... (358 more lines truncated, raise DATABRICKS_CLI_TEST_MAX_LOG to see more)

@eng-dev-ecosystem-bot

eng-dev-ecosystem-bot commented Nov 18, 2026 •

Copy link
Copy Markdown
Collaborator

✅ Integration test report

Commit: b376767

Run: 44350413179

Env 🤯​MISS 💚​RECOVERED ✅​pass 🙈​skip Time
💚​ aws linux-2core-8gb 1 360 21 49:59
💚​ aws-windows-latest-4core-16gb 1 362 19 57:22
🤯​ azure linux-2core-8gb 1 1 271 21 11:48
🤯​ azure-windows-latest-4core-16gb 1 1 273 19 7:24
🤯​ gcp linux-2core-8gb 1 1 272 21 10:39
🤯​ gcp-windows-latest-4core-16gb 1 1 274 19 8:05
Test Name aws linux-2core-8gb aws-windows-latest-4core-16gb azure linux-2core-8gb azure-windows-latest-4core-16gb gcp linux-2core-8gb gcp-windows-latest-4core-16gb
💚​ TestAccept 💚​R 💚​R 💚​R 💚​R 💚​R 💚​R
🤯​ TestAccept/bundle/invariant/no_drift ✅​p ✅​p 🤯​M 🤯​M 🤯​M 🤯​M
Top 50 slowest tests (at least 2 minutes):
duration env testname
9:16 aws-windows-latest-4core-16gb TestAccept/bundle/invariant/no_drift/DMS=true/INPUT_CONFIG=cluster_libraries.yml.tmpl/READPLAN=
6:57 aws linux-2core-8gb TestAccept/bundle/invariant/no_drift/DMS=true/INPUT_CONFIG=cluster_libraries.yml.tmpl/READPLAN=1
6:22 aws linux-2core-8gb TestAccept/bundle/invariant/no_drift/DMS=true/INPUT_CONFIG=cluster_apply_policy_default_values.yml.tmpl/READPLAN=
6:02 aws-windows-latest-4core-16gb TestAccept/bundle/invariant/no_drift/DMS=true/INPUT_CONFIG=pipeline_apply_policy_default_values.yml.tmpl/READPLAN=1
5:17 aws linux-2core-8gb TestAccept/bundle/invariant/no_drift/DMS=true/INPUT_CONFIG=cluster_libraries.yml.tmpl/READPLAN=
5:03 aws linux-2core-8gb TestAccept/bundle/invariant/no_drift/DMS=true/INPUT_CONFIG=volume.yml.tmpl/READPLAN=
5:00 aws linux-2core-8gb TestImportDir
4:41 aws linux-2core-8gb TestAccept/bundle/invariant/no_drift/DMS=true/INPUT_CONFIG=job.yml.tmpl/READPLAN=
4:30 aws-windows-latest-4core-16gb TestAccept/bundle/invariant/no_drift/DMS=true/INPUT_CONFIG=feature.yml.tmpl/READPLAN=1
4:18 aws-windows-latest-4core-16gb TestAccept/bundle/invariant/no_drift/DMS=true/INPUT_CONFIG=job_run.yml.tmpl/READPLAN=1
4:14 aws-windows-latest-4core-16gb TestAccept/bundle/invariant/no_drift/DMS=true/INPUT_CONFIG=registered_model.yml.tmpl/READPLAN=
4:08 aws-windows-latest-4core-16gb TestAccept/bundle/invariant/no_drift/DMS=true/INPUT_CONFIG=app.yml.tmpl/READPLAN=
4:08 aws linux-2core-8gb TestAccept/bundle/invariant/no_drift/DMS=true/INPUT_CONFIG=volume.yml.tmpl/READPLAN=1
4:03 aws linux-2core-8gb TestAccept/bundle/invariant/no_drift/DMS=true/INPUT_CONFIG=secret.yml.tmpl/READPLAN=
4:00 aws-windows-latest-4core-16gb TestAccept/bundle/invariant/no_drift/DMS=true/INPUT_CONFIG=job_cross_resource_ref.yml.tmpl/READPLAN=1
4:00 aws linux-2core-8gb TestAccept/bundle/invariant/no_drift/DMS=true/INPUT_CONFIG=catalog.yml.tmpl/READPLAN=
4:00 aws-windows-latest-4core-16gb TestAccept/bundle/invariant/no_drift/DMS=true/INPUT_CONFIG=pipeline_allow_duplicate_names.yml.tmpl/READPLAN=1
3:59 aws linux-2core-8gb TestAccept/bundle/invariant/no_drift/DMS=true/INPUT_CONFIG=registered_model.yml.tmpl/READPLAN=1
3:52 aws-windows-latest-4core-16gb TestAccept/bundle/invariant/no_drift/DMS=true/INPUT_CONFIG=volume_uppercase_name.yml.tmpl/READPLAN=
3:47 aws-windows-latest-4core-16gb TestAccept/bundle/invariant/no_drift/DMS=true/INPUT_CONFIG=job.yml.tmpl/READPLAN=
3:46 aws-windows-latest-4core-16gb TestAccept/bundle/invariant/no_drift/DMS=true/INPUT_CONFIG=vector_search_index.yml.tmpl/READPLAN=
3:45 aws-windows-latest-4core-16gb TestAccept/bundle/invariant/no_drift/DMS=true/INPUT_CONFIG=feature.yml.tmpl/READPLAN=
3:44 aws-windows-latest-4core-16gb TestAccept/bundle/invariant/no_drift/DMS=true/INPUT_CONFIG=volume_uppercase_name.yml.tmpl/READPLAN=1
3:40 aws-windows-latest-4core-16gb TestAccept/bundle/invariant/no_drift/DMS=true/INPUT_CONFIG=registered_model.yml.tmpl/READPLAN=1
3:38 aws-windows-latest-4core-16gb TestAccept/bundle/invariant/no_drift/DMS=true/INPUT_CONFIG=job_pydabs_10_tasks.yml.tmpl/READPLAN=
3:37 aws-windows-latest-4core-16gb TestAccept/bundle/invariant/no_drift/DMS=true/INPUT_CONFIG=genie_space.yml.tmpl/READPLAN=
3:34 aws linux-2core-8gb TestAccept/bundle/invariant/no_drift/DMS=true/INPUT_CONFIG=cluster.yml.tmpl/READPLAN=
3:32 aws linux-2core-8gb TestAccept/bundle/invariant/no_drift/DMS=true/INPUT_CONFIG=secret_scope_default_backend_type.yml.tmpl/READPLAN=
3:31 aws-windows-latest-4core-16gb TestAccept/bundle/invariant/no_drift/DMS=true/INPUT_CONFIG=secret_scope_default_backend_type.yml.tmpl/READPLAN=1
3:29 azure-windows-latest-4core-16gb TestAccept
3:29 gcp-windows-latest-4core-16gb TestAccept
3:28 aws-windows-latest-4core-16gb TestAccept/bundle/invariant/no_drift/DMS=true/INPUT_CONFIG=schema.yml.tmpl/READPLAN=
3:27 aws-windows-latest-4core-16gb TestAccept/bundle/invariant/no_drift/DMS=true/INPUT_CONFIG=cluster_libraries.yml.tmpl/READPLAN=1
3:25 aws-windows-latest-4core-16gb TestAccept/bundle/invariant/no_drift/DMS=true/INPUT_CONFIG=schema_uppercase_name.yml.tmpl/READPLAN=
3:23 aws linux-2core-8gb TestAccept/bundle/invariant/no_drift/DMS=true/INPUT_CONFIG=cluster_policy.yml.tmpl/READPLAN=
3:23 aws-windows-latest-4core-16gb TestAccept/bundle/invariant/no_drift/DMS=true/INPUT_CONFIG=experiment.yml.tmpl/READPLAN=1
3:22 aws-windows-latest-4core-16gb TestAccept/bundle/invariant/no_drift/DMS=true/INPUT_CONFIG=instance_pool.yml.tmpl/READPLAN=
3:20 aws-windows-latest-4core-16gb TestAccept/bundle/invariant/no_drift/DMS=true/INPUT_CONFIG=cluster_apply_policy_default_values.yml.tmpl/READPLAN=1
3:18 aws linux-2core-8gb TestAccept/bundle/invariant/no_drift/DMS=true/INPUT_CONFIG=volume_path_job_ref.yml.tmpl/READPLAN=1
3:14 aws linux-2core-8gb TestAccept/bundle/invariant/no_drift/DMS=true/INPUT_CONFIG=cluster_apply_policy_default_values.yml.tmpl/READPLAN=1
3:10 aws linux-2core-8gb TestAccept/bundle/invariant/no_drift/DMS=true/INPUT_CONFIG=app.yml.tmpl/READPLAN=
3:10 aws linux-2core-8gb TestAccept/bundle/invariant/no_drift/DMS=true/INPUT_CONFIG=cluster.yml.tmpl/READPLAN=1
3:00 aws-windows-latest-4core-16gb TestAccept/bundle/invariant/no_drift/DMS=true/INPUT_CONFIG=job_apply_policy_default_values_task_cluster.yml.tmpl/READPLAN=
2:59 aws-windows-latest-4core-16gb TestAccept/bundle/invariant/no_drift/DMS=true/INPUT_CONFIG=pipeline_config_dots.yml.tmpl/READPLAN=1
2:56 aws-windows-latest-4core-16gb TestImportDir
2:56 aws-windows-latest-4core-16gb TestAccept/bundle/invariant/no_drift/DMS=true/INPUT_CONFIG=cluster_policy.yml.tmpl/READPLAN=1
2:55 aws linux-2core-8gb TestAccept/bundle/invariant/no_drift/DMS=true/INPUT_CONFIG=pipeline.yml.tmpl/READPLAN=
2:55 aws-windows-latest-4core-16gb TestAccept/bundle/invariant/no_drift/DMS=true/INPUT_CONFIG=vector_search_index.yml.tmpl/READPLAN=1
2:54 aws linux-2core-8gb TestAccept/bundle/invariant/no_drift/DMS=true/INPUT_CONFIG=feature.yml.tmpl/READPLAN=
2:54 aws linux-2core-8gb TestAccept/bundle/invariant/no_drift/DMS=true/INPUT_CONFIG=schema_uppercase_name.yml.tmpl/READPLAN=

…rsions

A create the SDK retries after a 504 or a timeout can come back as 409 once
the first attempt was applied. A deployment that already has versions
existed before this run, so it is not taken over.

aws: TestAccept/bundle/invariant/no_drift/DMS=true

Co-authored-by: Isaac <no-reply@databricks.com>
@denik
denik marked this pull request as ready for review November 18, 2026 15:18
@denik
denik requested review from a team as code owners November 18, 2026 15:18
@denik
denik requested review from Sankalp-Mittal, andrewnester, janniklasrose and rclarey and removed request for rclarey November 18, 2026 15:18
Comment thread bundle/phases/dms_test.go Resolved

@Sankalp-Mittal Sankalp-Mittal left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

[AI Generated] Review by review-factory (Claude Opus 5.5 + Claude Fable 5.2, cross-verified). Only points the reviewers agreed on are posted.

Design, could be simpler: mayHaveCreated picks by status code which create errors get a lookup, and the second commit already had to add 409 to it. Adoption is made safe by the LastVersionId == "" check, and a rejected create just finds no node. Looking up after every create error costs one get-status and drops mayHaveCreated, its test and the status list.

Comment thread bundle/phases/dms.go Resolved
Comment thread bundle/phases/dms.go Resolved
Comment thread acceptance/bundle/invariant/test.toml Resolved
…d create

Per review: a rejected create leaves no node, so the lookup can run after
every error, and the status classification goes. The testserver's
CreateDeployment now matches the service: a second create in the same
folder fails with ALREADY_EXISTS (it used to overwrite the node), and a
node with no record is finalized in place. create-response-lost covers the
recovered 409 after an SDK retry and the refused deployment with versions.

The LOG.*.err change moves to its own PR.

aws: TestAccept/bundle/invariant/no_drift/DMS=true

Co-authored-by: Isaac <no-reply@databricks.com>
@denik

denik commented Nov 18, 2026

Copy link
Copy Markdown
Contributor Author

@Sankalp-Mittal re the design point: agreed and done in b376767. The lookup runs after every create error, and mayHaveCreated, its test and the status list are gone. Adoption is still limited to a deployment whose record exists and has no versions. — AI agent (opus5.5, isaac_claude)

@denik
denik added this pull request to the merge queue Nov 18, 2026
Merged via the queue into main with commit 73b204d Nov 18, 2026
27 checks passed
@denik
denik deleted the dms-recover-created-deployment branch November 18, 2026 18:03
@eng-dev-ecosystem-bot

Copy link
Copy Markdown
Collaborator

❌ Integration test report

Commit: 73b204d

Run: 44365710488

Env 💥​PANIC ❌​FAIL 🟨​KNOWN 🤯​MISS 🔄​flaky 💚​RECOVERED ✅​pass 🙈​skip Time
💥​ aws linux-2core-8gb 1 3 30 14 1600 1384 320:00
❌​ aws-windows-latest-4core-16gb 3 21 14 1526 1412 320:04
❌​ azure linux-2core-8gb 9 1 14 1602 1394 327:47
❌​ azure-windows-latest-4core-16gb 9 1 14 1518 1422 327:34
💥​ gcp linux-2core-8gb 1 57 14 1563 1390 320:00
🔄​ gcp-windows-latest-4core-16gb 4 13 1532 1420 322:48
83 interesting tests: 57 MISS, 12 RECOVERED, 9 FAIL, 2 flaky, 2 PANIC, 1 KNOWN
Test Name aws linux-2core-8gb aws-windows-latest-4core-16gb azure linux-2core-8gb azure-windows-latest-4core-16gb gcp linux-2core-8gb gcp-windows-latest-4core-16gb
🟨​ TestAccept 🤯​M 🤯​M 🟨​K 🟨​K 🤯​M 💚​R
❌​ TestAccept/bundle/deployment/bind/alert ✅​p ✅​p ❌​F ❌​F ✅​p ✅​p
❌​ TestAccept/bundle/deployment/bind/alert/DMS= ✅​p ✅​p ❌​F ❌​F ✅​p ✅​p
❌​ TestAccept/bundle/deployment/bind/alert/DMS=true ✅​p ✅​p ❌​F ❌​F ✅​p ✅​p
❌​ TestAccept/bundle/generate/alert ✅​p ✅​p ❌​F ❌​F ✅​p ✅​p
❌​ TestAccept/bundle/generate/alert/DMS= ✅​p ✅​p ❌​F ❌​F ✅​p ✅​p
❌​ TestAccept/bundle/generate/alert/DMS=true ✅​p ✅​p ❌​F ❌​F ✅​p ✅​p
❌​ TestAccept/bundle/resources/apps/inline_config ❌​F ❌​F ❌​F ❌​F ✅​p 🔄​f
❌​ TestAccept/bundle/resources/apps/inline_config/DMS= ❌​F ❌​F ❌​F ❌​F ✅​p 🔄​f
❌​ TestAccept/bundle/resources/apps/inline_config/DMS=true ❌​F ❌​F ❌​F ❌​F ✅​p ✅​p
💚​ TestAccept/bundle/resources/apps/lifecycle-started 💚​R 💚​R 💚​R 💚​R 💚​R 💚​R
💚​ TestAccept/bundle/resources/apps/lifecycle-started-omitted 💚​R 💚​R 💚​R 💚​R 💚​R 💚​R
💚​ TestAccept/bundle/resources/apps/lifecycle-started-omitted/DMS= 💚​R 💚​R 💚​R 💚​R 💚​R 💚​R
💚​ TestAccept/bundle/resources/apps/lifecycle-started-omitted/DMS=true 💚​R 💚​R 💚​R 💚​R 💚​R 💚​R
💚​ TestAccept/bundle/resources/apps/lifecycle-started-toggle 💚​R 💚​R 💚​R 💚​R 💚​R 💚​R
💚​ TestAccept/bundle/resources/apps/lifecycle-started-toggle/DMS= 💚​R 💚​R 💚​R 💚​R 💚​R 💚​R
💚​ TestAccept/bundle/resources/apps/lifecycle-started-toggle/DMS=true 💚​R 💚​R 💚​R 💚​R 💚​R 💚​R
💚​ TestAccept/bundle/resources/apps/lifecycle-started/DMS= 💚​R 💚​R 💚​R 💚​R 💚​R 💚​R
💚​ TestAccept/bundle/resources/apps/lifecycle-started/DMS=true 💚​R 💚​R 💚​R 💚​R 💚​R 💚​R
💚​ TestAccept/bundle/resources/postgres_synced_tables/basic 💚​R 💚​R 💚​R 💚​R 💚​R 💚​R
💚​ TestAccept/bundle/resources/postgres_synced_tables/basic/DMS= 💚​R 💚​R 💚​R 💚​R 💚​R 💚​R
🔄​ TestAccept/bundle/resources/postgres_synced_tables/recreate 💚​R 💚​R 💚​R 💚​R 💚​R 🔄​f
💚​ TestAccept/bundle/resources/postgres_synced_tables/recreate/DMS= 💚​R 💚​R 💚​R 💚​R 💚​R 💚​R
🔄​ TestAccept/bundle/resources/postgres_synced_tables/recreate/DMS=true 💚​R 💚​R 💚​R 💚​R 💚​R 🔄​f
🤯​ TestAccept/bundle/resources/schemas/rename ✅​p ✅​p ✅​p ✅​p 🤯​M ✅​p
🤯​ TestAccept/bundle/resources/schemas/rename/DMS= ✅​p ✅​p ✅​p ✅​p 🤯​M ✅​p
🤯​ TestAccept/bundle/resources/schemas/rename/DMS=true ✅​p ✅​p ✅​p ✅​p 🤯​M ✅​p
🤯​ TestAccept/bundle/resources/schemas/rename_case_only 🤯​M ✅​p ✅​p ✅​p 🤯​M ✅​p
🤯​ TestAccept/bundle/resources/schemas/rename_case_only/DMS= 🤯​M ✅​p ✅​p ✅​p 🤯​M ✅​p
🤯​ TestAccept/bundle/resources/schemas/rename_case_only/DMS=true 🤯​M ✅​p ✅​p ✅​p 🤯​M ✅​p
🤯​ TestAccept/bundle/resources/schemas/rename_out_of_band 🤯​M ✅​p ✅​p ✅​p 🤯​M ✅​p
🤯​ TestAccept/bundle/resources/schemas/rename_out_of_band/DMS= 🤯​M ✅​p ✅​p ✅​p 🤯​M ✅​p
🤯​ TestAccept/bundle/resources/schemas/rename_out_of_band/DMS=true 🤯​M ✅​p ✅​p ✅​p 🤯​M ✅​p
🤯​ TestAccept/bundle/resources/schemas/rename_out_of_band_old_state 🤯​M ✅​p ✅​p ✅​p 🤯​M ✅​p
🤯​ TestAccept/bundle/resources/schemas/rename_out_of_band_old_state/DMS=/READPLAN= 🤯​M ✅​p ✅​p ✅​p 🤯​M ✅​p
💥​ TestAccept/bundle/resources/schemas/rename_out_of_band_old_state/DMS=/READPLAN=1 💥​P ✅​p ✅​p ✅​p 🤯​M ✅​p
🤯​ TestAccept/bundle/resources/schemas/rename_referenced_by_name ✅​p ✅​p ✅​p ✅​p 🤯​M ✅​p
🤯​ TestAccept/bundle/resources/schemas/rename_referenced_by_name/DMS= ✅​p ✅​p ✅​p ✅​p 🤯​M ✅​p
🤯​ TestAccept/bundle/resources/schemas/rename_referenced_by_name/DMS=true ✅​p ✅​p ✅​p ✅​p 🤯​M ✅​p
🤯​ TestAccept/bundle/resources/schemas/rename_then_change 🤯​M ✅​p ✅​p ✅​p 🤯​M ✅​p
🤯​ TestAccept/bundle/resources/schemas/rename_then_change/DMS= 🤯​M ✅​p ✅​p ✅​p 🤯​M ✅​p
🤯​ TestAccept/bundle/resources/schemas/rename_then_change/DMS=true 🤯​M ✅​p ✅​p ✅​p 🤯​M ✅​p
🤯​ TestAccept/bundle/resources/schemas/rename_with_model_and_secret ✅​p ✅​p ✅​p ✅​p 🤯​M ✅​p
🤯​ TestAccept/bundle/resources/schemas/rename_with_model_and_secret/DMS= ✅​p ✅​p ✅​p ✅​p 🤯​M ✅​p
🤯​ TestAccept/bundle/resources/schemas/rename_with_model_and_secret/DMS=true ✅​p ✅​p ✅​p ✅​p 🤯​M ✅​p
🤯​ TestAccept/bundle/resources/schemas/rename_with_volume ✅​p ✅​p ✅​p ✅​p 🤯​M ✅​p
🤯​ TestAccept/bundle/resources/schemas/rename_with_volume/DMS=/READPLAN= ✅​p ✅​p ✅​p ✅​p 🤯​M ✅​p
🤯​ TestAccept/bundle/resources/schemas/rename_with_volume/DMS=/READPLAN=1 ✅​p ✅​p ✅​p ✅​p 🤯​M ✅​p
🤯​ TestAccept/bundle/resources/schemas/rename_with_volume/DMS=true/READPLAN= ✅​p ✅​p ✅​p ✅​p 🤯​M ✅​p
🤯​ TestAccept/bundle/resources/schemas/rename_with_volume/DMS=true/READPLAN=1 ✅​p ✅​p ✅​p ✅​p 🤯​M ✅​p
🤯​ TestAccept/bundle/resources/schemas/rename_with_volume_ref ✅​p ✅​p ✅​p ✅​p 🤯​M ✅​p
💥​ TestAccept/bundle/resources/schemas/rename_with_volume_ref/DMS= ✅​p ✅​p ✅​p ✅​p 💥​P ✅​p
🤯​ TestAccept/bundle/resources/schemas/rename_with_volume_ref/DMS=true ✅​p ✅​p ✅​p ✅​p 🤯​M ✅​p
🤯​ TestAccept/bundle/resources/secret_scopes/basic ✅​p ✅​p ✅​p ✅​p 🤯​M ✅​p
🤯​ TestAccept/bundle/resources/secret_scopes/basic/DMS= ✅​p ✅​p ✅​p ✅​p 🤯​M ✅​p
🤯​ TestAccept/bundle/resources/secret_scopes/basic/DMS=true ✅​p ✅​p ✅​p ✅​p 🤯​M ✅​p
🤯​ TestAccept/bundle/resources/secret_scopes/delete_scope ✅​p ✅​p ✅​p ✅​p 🤯​M ✅​p
🤯​ TestAccept/bundle/resources/secret_scopes/delete_scope/DMS=true ✅​p ✅​p ✅​p ✅​p 🤯​M ✅​p
🤯​ TestAccept/bundle/resources/secret_scopes/permissions ✅​p ✅​p ✅​p ✅​p 🤯​M ✅​p
🤯​ TestAccept/bundle/resources/secret_scopes/permissions/DMS=true ✅​p ✅​p ✅​p ✅​p 🤯​M ✅​p
🤯​ TestAccept/bundle/resources/secrets/remove-expire-time ✅​p ✅​p ✅​p ✅​p 🤯​M ✅​p
🤯​ TestAccept/bundle/resources/secrets/remove-expire-time/DMS= ✅​p ✅​p ✅​p ✅​p 🤯​M ✅​p
🤯​ TestAccept/bundle/resources/secrets/remove-expire-time/DMS=true ✅​p ✅​p ✅​p ✅​p 🤯​M ✅​p
🤯​ TestAccept/bundle/resources/vector_search_indexes/schema_normalization ✅​p 🤯​M ✅​p ✅​p ✅​p ✅​p
🤯​ TestAccept/bundle/resources/vector_search_indexes/schema_normalization/DMS=true ✅​p 🤯​M ✅​p ✅​p ✅​p ✅​p
🤯​ TestCIUniqueName 🤯​M 🤯​M ✅​p ✅​p 🤯​M ✅​p
🤯​ TestClassifyRegression 🤯​M 🤯​M ✅​p ✅​p 🤯​M ✅​p
🤯​ TestDbrAcceptance 🤯​M 🤯​M 🙈​s 🙈​s 🤯​M 🙈​s
🤯​ TestInprocessMode 🤯​M 🤯​M 🙈​s 🙈​s 🤯​M 🙈​s
🤯​ TestInvariantConfigsCoverage 🤯​M 🤯​M ✅​p ✅​p 🤯​M ✅​p
🤯​ TestLeafTests 🤯​M 🤯​M ✅​p ✅​p 🤯​M ✅​p
🤯​ TestParseTestOutput 🤯​M 🤯​M ✅​p ✅​p 🤯​M ✅​p
🤯​ TestRenderRegressionReport 🤯​M 🤯​M ✅​p ✅​p 🤯​M ✅​p
🤯​ TestRenderRegressionReportDedupesIdenticalFailures 🤯​M 🤯​M ✅​p ✅​p 🤯​M ✅​p
🤯​ TestSubsetApproximatesPct 🤯​M 🤯​M ✅​p ✅​p 🤯​M ✅​p
🤯​ TestSubsetChangedAlwaysRuns 🤯​M 🤯​M ✅​p ✅​p 🤯​M ✅​p
🤯​ TestSubsetChangedVariantFilter 🤯​M 🤯​M ✅​p ✅​p 🤯​M ✅​p
🤯​ TestSubsetChangedVariantFilterAlternatives 🤯​M 🤯​M ✅​p ✅​p 🤯​M ✅​p
🤯​ TestSubsetDisabled 🤯​M 🤯​M ✅​p ✅​p 🤯​M ✅​p
🤯​ TestSubsetPctBoundaries 🤯​M 🤯​M ✅​p ✅​p 🤯​M ✅​p
🤯​ TestSubsetSeedChangesSelection 🤯​M 🤯​M ✅​p ✅​p 🤯​M ✅​p
🤯​ TestSubsetSeedDeterministic 🤯​M 🤯​M ✅​p ✅​p 🤯​M ✅​p
🤯​ TestSubsetVariantsIndependent 🤯​M 🤯​M ✅​p ✅​p 🤯​M ✅​p
Top 50 slowest tests (at least 2 minutes):
duration env testname
15:05 gcp linux-2core-8gb TestAccept/bundle/resources/apps/lifecycle-started/DMS=
14:20 gcp linux-2core-8gb TestAccept/bundle/resources/apps/lifecycle-started/DMS=true
12:02 aws-windows-latest-4core-16gb TestAccept/bundle/resources/apps/lifecycle-started/DMS=true
11:16 aws-windows-latest-4core-16gb TestAccept/bundle/resources/apps/lifecycle-started/DMS=
10:51 azure-windows-latest-4core-16gb TestAccept/bundle/resources/apps/lifecycle-started/DMS=true
10:35 azure-windows-latest-4core-16gb TestAccept/bundle/resources/apps/lifecycle-started/DMS=
10:25 gcp-windows-latest-4core-16gb TestAccept/bundle/resources/apps/lifecycle-started/DMS=
10:15 azure linux-2core-8gb TestAccept/bundle/resources/apps/lifecycle-started/DMS=true
10:04 aws linux-2core-8gb TestAccept/bundle/resources/apps/lifecycle-started/DMS=true
9:39 gcp-windows-latest-4core-16gb TestAccept/bundle/resources/apps/lifecycle-started/DMS=true
9:24 aws linux-2core-8gb TestAccept/bundle/resources/apps/lifecycle-started/DMS=
8:40 azure-windows-latest-4core-16gb TestAccept/bundle/resources/clusters/lifecycle-started/DMS=true
8:27 azure linux-2core-8gb TestAccept/bundle/resources/apps/lifecycle-started/DMS=
8:13 gcp-windows-latest-4core-16gb TestAccept/bundle/resources/clusters/deploy/local_ssd_count/DMS=true
8:13 gcp-windows-latest-4core-16gb TestAccept/bundle/resources/clusters/lifecycle-started/DMS=true
8:12 aws linux-2core-8gb TestAccept/bundle/config-remote-sync/multiple_resources/DMS=true
8:06 gcp-windows-latest-4core-16gb TestAccept/bundle/resources/clusters/lifecycle-started/DMS=
7:59 aws linux-2core-8gb TestAccept/bundle/config-remote-sync/multiple_resources/DMS=
7:54 gcp-windows-latest-4core-16gb TestAccept/bundle/resources/clusters/lifecycle-started-toggle/DMS=
7:48 aws-windows-latest-4core-16gb TestAccept/bundle/resources/clusters/lifecycle-started/DMS=
7:48 azure-windows-latest-4core-16gb TestAccept/bundle/resources/clusters/lifecycle-started/DMS=
7:44 gcp linux-2core-8gb TestAccept/bundle/resources/clusters/lifecycle-started/DMS=
7:44 azure linux-2core-8gb TestAccept/bundle/resources/materialization_sets/immutable/DMS=
7:37 gcp linux-2core-8gb TestAccept/bundle/resources/clusters/deploy/local_ssd_count/DMS=true
7:29 gcp-windows-latest-4core-16gb TestAccept/bundle/resources/clusters/lifecycle-started-toggle/DMS=true
7:23 aws-windows-latest-4core-16gb TestAccept/bundle/resources/clusters/lifecycle-started/DMS=true
7:21 gcp-windows-latest-4core-16gb TestAccept/bundle/resources/clusters/deploy/local_ssd_count/DMS=
7:13 aws-windows-latest-4core-16gb TestAccept/bundle/resources/apps/lifecycle-started-toggle/DMS=true
7:06 aws linux-2core-8gb TestAccept/bundle/invariant/no_drift/DMS=/INPUT_CONFIG=cluster_apply_policy_default_values.yml.tmpl/READPLAN=1
6:58 gcp linux-2core-8gb TestAccept/bundle/resources/clusters/lifecycle-started/DMS=true
6:51 aws linux-2core-8gb TestAccept/bundle/resources/clusters/lifecycle-started/DMS=true
6:49 aws-windows-latest-4core-16gb TestAccept/bundle/resources/clusters/deploy/simple/DMS=
6:40 aws linux-2core-8gb TestAccept/bundle/resources/clusters/lifecycle-started/DMS=
6:36 azure linux-2core-8gb TestAccept/bundle/config-remote-sync/multiple_resources/DMS=true
6:35 azure linux-2core-8gb TestAccept/bundle/resources/clusters/lifecycle-started/DMS=true
6:31 gcp linux-2core-8gb TestAccept/bundle/config-remote-sync/multiple_resources/DMS=true
6:18 azure linux-2core-8gb TestAccept/bundle/config-remote-sync/multiple_resources/DMS=
6:17 azure linux-2core-8gb TestAccept/pipelines/run/refresh-flags
6:16 azure-windows-latest-4core-16gb TestAccept/bundle/resources/apps/lifecycle-started-omitted/DMS=
6:14 azure-windows-latest-4core-16gb TestAccept/pipelines/run/refresh-flags
6:11 gcp linux-2core-8gb TestAccept/bundle/config-remote-sync/multiple_resources/DMS=
6:10 azure linux-2core-8gb TestAccept/bundle/resources/clusters/lifecycle-started/DMS=
6:09 aws-windows-latest-4core-16gb TestAccept/bundle/resources/clusters/lifecycle-started-toggle/DMS=true
5:59 gcp linux-2core-8gb TestAccept/bundle/resources/clusters/lifecycle-started-toggle/DMS=
5:58 gcp-windows-latest-4core-16gb TestAccept/bundle/resources/registered_models/basic/DMS=true
5:54 gcp linux-2core-8gb TestAccept/bundle/resources/apps/lifecycle-started-omitted/DMS=true
5:54 azure linux-2core-8gb TestAccept/bundle/resources/materialization_sets/batch/DMS=
5:54 gcp linux-2core-8gb TestAccept/bundle/resources/apps/lifecycle-started-toggle/DMS=true
5:50 aws linux-2core-8gb TestAccept/bundle/resources/materialization_sets/immutable/DMS=true
5:48 azure linux-2core-8gb TestAccept/bundle/resources/apps/lifecycle-started-toggle/DMS=

@denik denik added factory-generated and removed ai-auto Deprecated: use factory-generated instead. labels Nov 20, 2026
idelafuente-oc pushed a commit to idelafuente-oc/cli that referenced this pull request Nov 20, 2026
…s#7779)

## Changes
- `acceptance/bundle/invariant/test.toml` no longer ignores `*.err`. The
harness checks the ignore patterns before the `LOG` prefix, so the
`LOG.*.err` files these scripts write (`bundle plan -o json > ...
2>LOG.plan_initial.err`, `LOG.planjson.err`, ...) were never printed. A
failing plan then left only `Exit code: 1` in the test log. Every `.err`
file under `acceptance/bundle/invariant` is a `LOG.*` file, so no test
gains an unexpected output file.

## Why
Split out of databricks#7770 at review. This makes the silent invariant failures
behind error/1045 diagnosable. It does not fix them: the recent ones
have different causes (a vector search endpoint plan, an app plan).

## Tests
`TestAccept/bundle/invariant` passes locally.

## Dashboard
| error | verbatim snippet |
|---|---|
|
[error/1045](http://go/cli/dashboard/error/1045?main=1&pr=1&end=2026-11-18T12:00:00Z&last=7d)
| `expected: "INPUT_CONFIG_OK\n"`, `actual : "\nExit code: 1\n"` |

This pull request and its description were written by Isaac.

Co-authored-by: Isaac <no-reply@databricks.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

DABs DABs related issues factory-generated

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants