Skip to content

acc: add plan_filter.py to keep backend-owned remote_state out of plan goldens - #7764

Merged
denik merged 3 commits into
mainfrom
acc-plan-filter-remote-state
Nov 18, 2026
Merged

denik merged 3 commits into
mainfrom
acc-plan-filter-remote-state

Conversation

@denik

@denik denik commented Nov 18, 2026 •

Copy link
Copy Markdown
Contributor

Changes

New acceptance helper acceptance/bin/plan_filter.py: reads bundle plan -o json on stdin, drops remote_state from every plan entry and removes the deployment stamp (reusing nostamp.render). With a resource key it prints just that entry, and fails if the key isn't in the plan. So

$CLI bundle plan -o json | nostamp | jq '(.plan."resources.X.y" // .) | del(.remote_state)'

becomes

$CLI bundle plan -o json | plan_filter.py resources.X.y

It's covered by a selftest (acceptance/selftest/plan_filter) and documented in .agents/rules/testing.md, along with a rule to use it unless a test checks remote_state itself.

Applied to the cloud postgres plan tests: postgres_branches/update_protected, postgres_databases/update, postgres_roles/update, postgres_projects/add_default_endpoint_settings, plus postgres_projects/update_display_name and postgres_endpoints/update_autoscaling, which already dropped remote_state with jq. The golden updates only remove remote_state blocks (3 insertions, all from trailing-comma changes, 193 deletions).

Why

remote_state is the backend's GET response copied into the plan as is: status, timestamps, sizes, UIDs, and any field the backend starts returning. If a golden records it, the test fails whenever the backend changes, even when the CLI's decision (action, new_state, changes) is the same, and the failure shows up on every cloud at once. changes[*].remote still records the remote value of each field the plan compares.

Measured on main before this PR:

error snippet (inside remote_state)
error/2961 + "compute_last_active_time": "[TIMESTAMP]",
error/2893 Unexpected output "status": "MONITOR_STATUS_PENDING",

Decisions

  • Tests opt in with a helper; the runner doesn't strip remote_state by default. Some tests check remote_state on purpose (dashboards' serialized_dashboard, grants' __embed__ principals, apps/config-env-no-drift, quality_monitors' allow-list), and a filter hidden in the runner would make those goldens misleading.
  • changes[*].remote is kept. It's the input to the CLI's drift decision, and out-of-band tests depend on it.
  • When the resource key is missing, plan_filter.py fails. The old jq '.plan."KEY" // .' silently wrote the whole plan instead. None of the converted goldens relied on that fallback, and a missing entry should fail loudly.
  • For skip entries (the no_change goldens), only action is left, because a skip has no changes. That's intended: the plan's decision is the assertion. If a broken read changed what the CLI sees, the action would turn into update or recreate, and that still shows up.
  • It's a separate script rather than a flag on nostamp.py. nostamp is also used for states and request bodies, where remote_state doesn't apply. plan_filter.py reuses nostamp.render, so stamp handling stays in one place.
  • Scope is the postgres family, which has churned the most. The other cloud goldens that record remote_state (dashboards, grants, quality_monitors) check it on purpose or already filter it. Local-only tests can adopt the helper when they're next touched.

Tests

  • selftest/plan_filter (local): whole plan, one entry, missing entry, non-plan and empty input.
  • All 12 variants (DMS= and DMS=true) of the six postgres tests pass on AWS (testme-aws). The last commit message requests the same AWS run in CI.

Dashboard

error/3534, error/3535, error/3537: these motivated the change. They were already fixed on main by #7596, and this PR wouldn't have prevented them (see above). It does prevent the class above: error/2961, error/3587, error/2964, error/3526.

Plan differs (out.plan.update.json): Unexpected output "is_protected": false, "no_expiry": true,
Plan differs (out.plan.restore.json): Unexpected output "compute_last_active_time": "[TIMESTAMP]",

This pull request and its description were written by Isaac.

…n goldens

remote_state in a plan entry is the backend's GET payload as is, so goldens
that record it fail whenever the backend adds a field or a computed status
value changes, even when the plan's action and changes stay the same.

plan_filter.py drops remote_state from every entry and the deployment stamp
(as nostamp does), optionally printing one entry. Use it in the postgres
update tests, replacing their per-test jq filters.

aws: TestAccept/bundle/resources/postgres_branches/update_protected TestAccept/bundle/resources/postgres_databases/update TestAccept/bundle/resources/postgres_roles/update TestAccept/bundle/resources/postgres_endpoints/update_autoscaling TestAccept/bundle/resources/postgres_projects/update_display_name TestAccept/bundle/resources/postgres_projects/add_default_endpoint_settings

Co-authored-by: Isaac <no-reply@databricks.com>
@denik denik added the ai-auto Deprecated: use factory-generated instead. label Nov 18, 2026
@github-actions github-actions Bot added the DABs DABs related issues label Nov 18, 2026
@github-actions

github-actions Bot commented Nov 18, 2026 •

Copy link
Copy Markdown
Contributor

Commit: 1a7af48e7 | Workflow run

Regression test report

Selected 7 changed tests (limit=20, 0 not selected)

13 tests: regression=0 unreleased=0 coverage=13 failing=0
test branch main (934ffd3) latest (v1.26.0)
TestAccept/bundle/resources/postgres_branches/update_protected/DMS= ✅ ✅ ✅
TestAccept/bundle/resources/postgres_branches/update_protected/DMS=true ✅ ✅ ✅
TestAccept/bundle/resources/postgres_databases/update/DMS= ✅ ✅ ✅
TestAccept/bundle/resources/postgres_databases/update/DMS=true ✅ ✅ ✅
TestAccept/bundle/resources/postgres_endpoints/update_autoscaling/DMS= ✅ ✅ ✅
TestAccept/bundle/resources/postgres_endpoints/update_autoscaling/DMS=true ✅ ✅ ✅
TestAccept/bundle/resources/postgres_projects/add_default_endpoint_settings/DMS= ✅ ✅ ✅
TestAccept/bundle/resources/postgres_projects/add_default_endpoint_settings/DMS=true ✅ ✅ ✅
TestAccept/bundle/resources/postgres_projects/update_display_name/DMS= ✅ ✅ ✅
TestAccept/bundle/resources/postgres_projects/update_display_name/DMS=true ✅ ✅ ✅
TestAccept/bundle/resources/postgres_roles/update/DMS= ✅ ✅ ✅
TestAccept/bundle/resources/postgres_roles/update/DMS=true ✅ ✅ ✅
TestAccept/selftest/plan_filter ✅ ✅ ✅

@eng-dev-ecosystem-bot

eng-dev-ecosystem-bot commented Nov 18, 2026 •

Copy link
Copy Markdown
Collaborator

✅ Integration test report

Commit: 1a7af48

Run: 44317213130

Env 💚​RECOVERED ✅​pass 🙈​skip Time
💚​ aws linux-2core-8gb 1 290 20 21:31
💚​ aws-windows-latest-4core-16gb 1 292 18 15:41
💚​ azure linux-2core-8gb 1 289 20 14:39
💚​ azure-windows-latest-4core-16gb 1 291 18 17:59
💚​ gcp linux-2core-8gb 1 290 20 14:51
💚​ gcp-windows-latest-4core-16gb 1 292 18 18:00
Test Name aws linux-2core-8gb aws-windows-latest-4core-16gb azure linux-2core-8gb azure-windows-latest-4core-16gb gcp linux-2core-8gb gcp-windows-latest-4core-16gb
💚​ TestAccept 💚​R 💚​R 💚​R 💚​R 💚​R 💚​R
Top 50 slowest tests (at least 2 minutes):
duration env testname
7:46 aws-windows-latest-4core-16gb TestAccept/bundle/resources/postgres_databases/update/DMS=
6:35 aws linux-2core-8gb TestAccept/bundle/resources/postgres_databases/update/DMS=
6:26 azure-windows-latest-4core-16gb TestAccept/bundle/resources/postgres_projects/update_display_name/DMS=true
6:21 gcp-windows-latest-4core-16gb TestAccept/bundle/resources/postgres_roles/update/DMS=true
6:04 aws-windows-latest-4core-16gb TestAccept/bundle/resources/postgres_branches/update_protected/DMS=true
5:51 azure-windows-latest-4core-16gb TestAccept/bundle/resources/postgres_branches/update_protected/DMS=
5:40 azure-windows-latest-4core-16gb TestAccept/bundle/resources/postgres_databases/update/DMS=true
5:39 gcp-windows-latest-4core-16gb TestAccept/bundle/resources/postgres_branches/update_protected/DMS=true
5:26 azure-windows-latest-4core-16gb TestAccept/bundle/resources/postgres_endpoints/update_autoscaling/DMS=true
5:23 aws linux-2core-8gb TestAccept/bundle/resources/postgres_branches/update_protected/DMS=
5:18 aws linux-2core-8gb TestAccept/bundle/resources/postgres_databases/update/DMS=true
5:15 gcp-windows-latest-4core-16gb TestAccept/bundle/resources/postgres_roles/update/DMS=
4:40 azure-windows-latest-4core-16gb TestFilerWorkspaceFilesExtensionsReadDir
4:29 gcp linux-2core-8gb TestAccept/bundle/resources/postgres_projects/update_display_name/DMS=
4:23 azure-windows-latest-4core-16gb TestAccept/bundle/resources/postgres_databases/update/DMS=
4:21 aws linux-2core-8gb TestFilerWorkspaceFilesExtensionsReadDir
4:17 gcp-windows-latest-4core-16gb TestAccept/bundle/resources/postgres_branches/update_protected/DMS=
4:13 gcp-windows-latest-4core-16gb TestAccept/bundle/resources/postgres_projects/update_display_name/DMS=
4:01 gcp-windows-latest-4core-16gb TestLockUnlockWithAllowsLockFileNotExist
4:00 aws-windows-latest-4core-16gb TestAccept/bundle/resources/postgres_databases/update/DMS=true
3:52 aws-windows-latest-4core-16gb TestAccept/bundle/resources/postgres_branches/update_protected/DMS=
3:52 aws linux-2core-8gb TestAccept/bundle/resources/postgres_endpoints/update_autoscaling/DMS=
3:50 aws-windows-latest-4core-16gb TestAccept/bundle/resources/postgres_endpoints/update_autoscaling/DMS=
3:49 aws-windows-latest-4core-16gb TestAccept/bundle/resources/postgres_endpoints/update_autoscaling/DMS=true
3:46 azure linux-2core-8gb TestAccept/bundle/resources/postgres_projects/update_display_name/DMS=
3:44 gcp-windows-latest-4core-16gb TestAccept/bundle/resources/postgres_databases/update/DMS=
3:42 gcp linux-2core-8gb TestAccept/bundle/resources/postgres_databases/update/DMS=true
3:38 gcp-windows-latest-4core-16gb TestAccept/bundle/resources/postgres_projects/update_display_name/DMS=true
3:33 azure-windows-latest-4core-16gb TestAccept
3:27 gcp-windows-latest-4core-16gb TestAccept/bundle/resources/postgres_endpoints/update_autoscaling/DMS=
3:24 gcp-windows-latest-4core-16gb TestAccept/bundle/resources/postgres_databases/update/DMS=true
3:20 aws-windows-latest-4core-16gb TestAccept/bundle/resources/postgres_roles/update/DMS=true
3:17 gcp linux-2core-8gb TestAccept/bundle/resources/postgres_endpoints/update_autoscaling/DMS=true
3:12 azure linux-2core-8gb TestAccept/bundle/resources/postgres_databases/update/DMS=true
3:10 gcp linux-2core-8gb TestAccept/bundle/resources/postgres_branches/update_protected/DMS=true
3:08 gcp-windows-latest-4core-16gb TestAccept
3:01 aws linux-2core-8gb TestAccept/bundle/resources/postgres_roles/update/DMS=true
3:01 gcp linux-2core-8gb TestAccept/bundle/resources/postgres_endpoints/update_autoscaling/DMS=
3:00 aws-windows-latest-4core-16gb TestFilerWorkspaceFilesExtensionsReadDir
2:59 azure-windows-latest-4core-16gb TestAccept/bundle/resources/postgres_projects/update_display_name/DMS=
2:54 azure linux-2core-8gb TestAccept/bundle/resources/postgres_endpoints/update_autoscaling/DMS=
2:52 gcp linux-2core-8gb TestAccept/bundle/resources/postgres_databases/update/DMS=
2:50 aws-windows-latest-4core-16gb TestAccept
2:48 azure-windows-latest-4core-16gb TestAccept/bundle/resources/postgres_endpoints/update_autoscaling/DMS=
2:45 gcp-windows-latest-4core-16gb TestFilerWorkspaceFilesExtensionsReadDir
2:44 gcp-windows-latest-4core-16gb TestAccept/bundle/resources/postgres_endpoints/update_autoscaling/DMS=true
2:44 gcp linux-2core-8gb TestAccept/bundle/resources/postgres_projects/update_display_name/DMS=true
2:43 gcp linux-2core-8gb TestAccept/bundle/resources/postgres_roles/update/DMS=
2:43 azure linux-2core-8gb TestAccept/bundle/resources/postgres_endpoints/update_autoscaling/DMS=true
2:42 aws linux-2core-8gb TestFilerRecursiveDelete/workspace_files_extensions

…ceback

aws: TestAccept/bundle/resources/postgres_branches/update_protected TestAccept/bundle/resources/postgres_databases/update TestAccept/bundle/resources/postgres_roles/update TestAccept/bundle/resources/postgres_endpoints/update_autoscaling TestAccept/bundle/resources/postgres_projects/update_display_name TestAccept/bundle/resources/postgres_projects/add_default_endpoint_settings

Co-authored-by: Isaac <no-reply@databricks.com>
@denik
denik marked this pull request as ready for review November 18, 2026 13:03
@denik
denik requested review from a team as code owners November 18, 2026 13:03

@review-oss-bot review-oss-bot Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks good to me — no issues found.

@Sankalp-Mittal Sankalp-Mittal left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

[AI Generated] Review by review-factory (Claude Fable 5.2 + Claude Opus 5.5, cross-verified). Only points the reviewers agreed on are posted.

No blocking or major issues found.

Comment thread .agents/rules/testing.md Resolved
Comment thread acceptance/bin/plan_filter.py Resolved
… shape

aws: TestAccept/bundle/resources/postgres_branches/update_protected TestAccept/bundle/resources/postgres_databases/update TestAccept/bundle/resources/postgres_roles/update TestAccept/bundle/resources/postgres_endpoints/update_autoscaling TestAccept/bundle/resources/postgres_projects/update_display_name TestAccept/bundle/resources/postgres_projects/add_default_endpoint_settings

Co-authored-by: Isaac <no-reply@databricks.com>
@denik
denik added this pull request to the merge queue Nov 18, 2026
Merged via the queue into main with commit 4c87e6a Nov 18, 2026
27 checks passed
@denik
denik deleted the acc-plan-filter-remote-state branch November 18, 2026 14:34
@eng-dev-ecosystem-bot

Copy link
Copy Markdown
Collaborator

❌ Integration test report

Commit: 4c87e6a

Run: 44325888398

Env 💥​PANIC ❌​FAIL 🤯​MISS 💚​RECOVERED ✅​pass 🙈​skip Time
💥​ aws linux-2core-8gb 1 3 745 9 872 1380 320:00
💥​ aws-windows-latest-4core-16gb 1 3 608 9 925 1408 320:04
💥​ azure linux-2core-8gb 1 3 678 9 919 1388 320:00
💥​ azure-windows-latest-4core-16gb 1 3 451 14 1057 1416 320:04
💥​ gcp linux-2core-8gb 1 488 9 1119 1386 320:00
💥​ gcp-windows-latest-4core-16gb 1 502 12 1018 1414 320:03
1348 interesting tests: 1335 MISS, 6 PANIC, 4 RECOVERED, 3 FAIL
Test Name aws linux-2core-8gb aws-windows-latest-4core-16gb azure linux-2core-8gb azure-windows-latest-4core-16gb gcp linux-2core-8gb gcp-windows-latest-4core-16gb
🤯​ TestAccept 🤯​M 🤯​M 🤯​M 🤯​M 🤯​M 🤯​M
🤯​ TestAccept/bundle/apps/job_permissions 🤯​M 🤯​M 🤯​M 🤯​M 🤯​M 🤯​M
🤯​ TestAccept/bundle/apps/job_permissions/DMS= 🤯​M 🤯​M 🤯​M 🤯​M 🤯​M 🤯​M
🤯​ TestAccept/bundle/apps/job_permissions/DMS=true 🤯​M 🤯​M 🤯​M 🤯​M 🤯​M 🤯​M
🤯​ TestAccept/bundle/artifacts/artifact_path_with_volume/volume_doesnot_exist 🤯​M 🤯​M 🤯​M 🤯​M 🤯​M 🤯​M
🤯​ TestAccept/bundle/artifacts/artifact_path_with_volume/volume_doesnot_exist/DMS= 🤯​M 🤯​M 🤯​M 🤯​M 🤯​M 🤯​M
🤯​ TestAccept/bundle/artifacts/artifact_path_with_volume/volume_doesnot_exist/DMS=true 🤯​M 🤯​M 🤯​M 🤯​M 🤯​M 🤯​M
🤯​ TestAccept/bundle/artifacts/artifact_path_with_volume/volume_not_deployed 🤯​M 🤯​M 🤯​M 🤯​M 🤯​M 🤯​M
🤯​ TestAccept/bundle/artifacts/artifact_path_with_volume/volume_not_deployed/DMS= 🤯​M 🤯​M 🤯​M 🤯​M 🤯​M 🤯​M
🤯​ TestAccept/bundle/artifacts/artifact_path_with_volume/volume_not_deployed/DMS=true 🤯​M 🤯​M 🤯​M 🤯​M 🤯​M 🤯​M
🤯​ TestAccept/bundle/config-remote-sync/cli_defaults 🤯​M 🙈​s 🤯​M 🙈​s 🤯​M 🙈​s
🤯​ TestAccept/bundle/config-remote-sync/cli_defaults/DMS= 🤯​M 🤯​M 🤯​M
🤯​ TestAccept/bundle/config-remote-sync/cli_defaults/DMS=true 🤯​M 🤯​M 🤯​M
🤯​ TestAccept/bundle/config-remote-sync/cluster_policy_cross_target 🤯​M 🙈​s 🤯​M 🙈​s 🤯​M 🙈​s
🤯​ TestAccept/bundle/config-remote-sync/cluster_policy_cross_target/DMS= 🤯​M 🤯​M 🤯​M
🤯​ TestAccept/bundle/config-remote-sync/cluster_policy_cross_target/DMS=true 🤯​M 🤯​M 🤯​M
🤯​ TestAccept/bundle/config-remote-sync/cluster_policy_permissions 🤯​M 🙈​s 🤯​M 🙈​s 🤯​M 🙈​s
🤯​ TestAccept/bundle/config-remote-sync/cluster_policy_permissions/DMS= 🤯​M 🤯​M 🤯​M
🤯​ TestAccept/bundle/config-remote-sync/cluster_policy_permissions/DMS=true 🤯​M 🤯​M 🤯​M
🤯​ TestAccept/bundle/config-remote-sync/cluster_policy_remote_addition 🤯​M 🙈​s 🤯​M 🙈​s 🤯​M 🙈​s
🤯​ TestAccept/bundle/config-remote-sync/cluster_policy_remote_addition/DMS= 🤯​M ✅​p 🤯​M
💥​ TestAccept/bundle/config-remote-sync/cluster_policy_remote_addition/DMS=true 🤯​M 💥​P 🤯​M
🤯​ TestAccept/bundle/config-remote-sync/config_edits 🤯​M 🙈​s 🤯​M 🙈​s 🤯​M 🙈​s
🤯​ TestAccept/bundle/config-remote-sync/config_edits/DMS= 🤯​M ✅​p 🤯​M
🤯​ TestAccept/bundle/config-remote-sync/config_edits/DMS=true 🤯​M 🤯​M 🤯​M
🤯​ TestAccept/bundle/config-remote-sync/dashboard_etag 🤯​M 🙈​s ✅​p 🙈​s 🤯​M 🙈​s
🤯​ TestAccept/bundle/config-remote-sync/dashboard_etag/DMS= 🤯​M ✅​p 🤯​M
🤯​ TestAccept/bundle/config-remote-sync/dashboard_etag/DMS=true 🤯​M ✅​p 🤯​M
🤯​ TestAccept/bundle/config-remote-sync/external_cluster_policy_cross_target 🤯​M 🙈​s 🤯​M 🙈​s 🤯​M 🙈​s
🤯​ TestAccept/bundle/config-remote-sync/external_cluster_policy_cross_target/DMS= 🤯​M ✅​p 🤯​M
🤯​ TestAccept/bundle/config-remote-sync/external_cluster_policy_cross_target/DMS=true 🤯​M 🤯​M 🤯​M
🤯​ TestAccept/bundle/config-remote-sync/flushed_cache 🤯​M 🙈​s ✅​p 🙈​s 🤯​M 🙈​s
🤯​ TestAccept/bundle/config-remote-sync/flushed_cache/DMS= 🤯​M ✅​p 🤯​M
🤯​ TestAccept/bundle/config-remote-sync/flushed_cache/DMS=true 🤯​M ✅​p 🤯​M
🤯​ TestAccept/bundle/config-remote-sync/formatting_preserved 🤯​M 🙈​s ✅​p 🙈​s 🤯​M 🙈​s
🤯​ TestAccept/bundle/config-remote-sync/formatting_preserved/DMS= 🤯​M ✅​p 🤯​M
🤯​ TestAccept/bundle/config-remote-sync/formatting_preserved/DMS=true 🤯​M ✅​p 🤯​M
🤯​ TestAccept/bundle/config-remote-sync/job_fields 🤯​M 🙈​s ✅​p 🙈​s 🤯​M 🙈​s
🤯​ TestAccept/bundle/config-remote-sync/job_fields/DMS= 🤯​M ✅​p 🤯​M
🤯​ TestAccept/bundle/config-remote-sync/job_fields/DMS=true 🤯​M ✅​p 🤯​M
🤯​ TestAccept/bundle/config-remote-sync/job_multiple_tasks 🤯​M 🙈​s ✅​p 🙈​s 🤯​M 🙈​s
🤯​ TestAccept/bundle/config-remote-sync/job_multiple_tasks/DMS= 🤯​M ✅​p 🤯​M
🤯​ TestAccept/bundle/config-remote-sync/job_multiple_tasks/DMS=true 🤯​M ✅​p 🤯​M
🤯​ TestAccept/bundle/config-remote-sync/job_params_variables 🤯​M 🙈​s ✅​p 🙈​s 🤯​M 🙈​s
🤯​ TestAccept/bundle/config-remote-sync/job_params_variables/DMS= 🤯​M ✅​p 🤯​M
🤯​ TestAccept/bundle/config-remote-sync/job_params_variables/DMS=true 🤯​M ✅​p 🤯​M
🤯​ TestAccept/bundle/config-remote-sync/job_pipeline_task 🤯​M 🙈​s ✅​p 🙈​s 🤯​M 🙈​s
🤯​ TestAccept/bundle/config-remote-sync/job_pipeline_task/DMS= 🤯​M ✅​p 🤯​M
🤯​ TestAccept/bundle/config-remote-sync/job_pipeline_task/DMS=true 🤯​M ✅​p 🤯​M
🤯​ TestAccept/bundle/config-remote-sync/json_status_missing_state 🤯​M 🙈​s ✅​p 🙈​s 🤯​M 🙈​s
🤯​ TestAccept/bundle/config-remote-sync/json_status_missing_state/DMS= 🤯​M ✅​p 🤯​M
🤯​ TestAccept/bundle/config-remote-sync/json_status_missing_state/DMS=true 🤯​M ✅​p 🤯​M
🤯​ TestAccept/bundle/config-remote-sync/json_status_selectors 🤯​M 🙈​s ✅​p 🙈​s 🤯​M 🙈​s
🤯​ TestAccept/bundle/config-remote-sync/json_status_selectors/DMS= 🤯​M ✅​p 🤯​M
🤯​ TestAccept/bundle/config-remote-sync/json_status_selectors/DMS=true 🤯​M ✅​p 🤯​M
🤯​ TestAccept/bundle/config-remote-sync/multiple_files 🤯​M 🙈​s ✅​p 🙈​s 🤯​M 🙈​s
🤯​ TestAccept/bundle/config-remote-sync/multiple_files/DMS= 🤯​M ✅​p 🤯​M
🤯​ TestAccept/bundle/config-remote-sync/multiple_files/DMS=true 🤯​M ✅​p 🤯​M
🤯​ TestAccept/bundle/config-remote-sync/multiple_resources 🤯​M 🙈​s ✅​p 🙈​s 🤯​M 🙈​s
🤯​ TestAccept/bundle/config-remote-sync/multiple_resources/DMS= 🤯​M ✅​p 🤯​M
🤯​ TestAccept/bundle/config-remote-sync/multiple_resources/DMS=true 🤯​M ✅​p 🤯​M
🤯​ TestAccept/bundle/config-remote-sync/output_json 🤯​M 🙈​s ✅​p 🙈​s 🤯​M 🙈​s
🤯​ TestAccept/bundle/config-remote-sync/output_json/DMS= 🤯​M ✅​p 🤯​M
🤯​ TestAccept/bundle/config-remote-sync/output_json/DMS=true 🤯​M ✅​p 🤯​M
🤯​ TestAccept/bundle/config-remote-sync/output_no_changes 🤯​M 🙈​s ✅​p 🙈​s 🤯​M 🙈​s
🤯​ TestAccept/bundle/config-remote-sync/output_no_changes/DMS= 🤯​M ✅​p 🤯​M
🤯​ TestAccept/bundle/config-remote-sync/output_no_changes/DMS=true 🤯​M ✅​p 🤯​M
🤯​ TestAccept/bundle/config-remote-sync/pipeline_fields 🤯​M 🙈​s ✅​p 🙈​s 🤯​M 🙈​s
🤯​ TestAccept/bundle/config-remote-sync/pipeline_fields/DMS= 🤯​M ✅​p 🤯​M
🤯​ TestAccept/bundle/config-remote-sync/pipeline_fields/DMS=true 🤯​M ✅​p 🤯​M
🤯​ TestAccept/bundle/config-remote-sync/policy_injected_cluster_fields 🤯​M 🙈​s ✅​p 🙈​s 🤯​M 🙈​s
🤯​ TestAccept/bundle/config-remote-sync/policy_injected_cluster_fields/DMS= 🤯​M ✅​p 🤯​M
🤯​ TestAccept/bundle/config-remote-sync/policy_injected_cluster_fields/DMS=true 🤯​M ✅​p 🤯​M
🤯​ TestAccept/bundle/config-remote-sync/resolve_variables 🤯​M 🙈​s ✅​p 🙈​s 🤯​M 🙈​s
🤯​ TestAccept/bundle/config-remote-sync/resolve_variables/DMS= 🤯​M ✅​p 🤯​M
🤯​ TestAccept/bundle/config-remote-sync/resolve_variables/DMS=true 🤯​M ✅​p 🤯​M
🤯​ TestAccept/bundle/config-remote-sync/select_basic 🤯​M 🙈​s ✅​p 🙈​s 🤯​M 🙈​s
🤯​ TestAccept/bundle/config-remote-sync/select_basic/DMS= 🤯​M ✅​p 🤯​M
🤯​ TestAccept/bundle/config-remote-sync/select_basic/DMS=true 🤯​M ✅​p 🤯​M
🤯​ TestAccept/bundle/config-remote-sync/select_multiple 🤯​M 🙈​s ✅​p 🙈​s 🤯​M 🙈​s
🤯​ TestAccept/bundle/config-remote-sync/select_multiple/DMS= 🤯​M ✅​p 🤯​M
🤯​ TestAccept/bundle/config-remote-sync/select_multiple/DMS=true 🤯​M ✅​p 🤯​M
🤯​ TestAccept/bundle/config-remote-sync/skip_deployment 🤯​M 🙈​s ✅​p 🙈​s 🤯​M 🙈​s
🤯​ TestAccept/bundle/config-remote-sync/skip_deployment/DMS= 🤯​M ✅​p 🤯​M
🤯​ TestAccept/bundle/config-remote-sync/skip_deployment/DMS=true 🤯​M ✅​p 🤯​M
🤯​ TestAccept/bundle/config-remote-sync/skip_permissions 🤯​M 🙈​s 🤯​M 🙈​s 🤯​M 🙈​s
🤯​ TestAccept/bundle/config-remote-sync/skip_permissions/DMS= 🤯​M 🤯​M 🤯​M
🤯​ TestAccept/bundle/config-remote-sync/skip_permissions/DMS=true 🤯​M 🤯​M 🤯​M
🤯​ TestAccept/bundle/config-remote-sync/target_override 🤯​M 🙈​s ✅​p 🙈​s 🤯​M 🙈​s
🤯​ TestAccept/bundle/config-remote-sync/target_override/DMS= 🤯​M ✅​p 🤯​M
🤯​ TestAccept/bundle/config-remote-sync/target_override/DMS=true 🤯​M ✅​p 🤯​M
🤯​ TestAccept/bundle/config-remote-sync/task_rename_revert 🤯​M 🙈​s ✅​p 🙈​s 🤯​M 🙈​s
🤯​ TestAccept/bundle/config-remote-sync/task_rename_revert/DMS= 🤯​M ✅​p 🤯​M
🤯​ TestAccept/bundle/config-remote-sync/task_rename_revert/DMS=true 🤯​M ✅​p 🤯​M
🤯​ TestAccept/bundle/debug/fetch-repository-info 🤯​M 🤯​M ✅​p 🤯​M 🤯​M 🤯​M
🤯​ TestAccept/bundle/debug/fetch-repository-info/DMS= 🤯​M 🤯​M ✅​p 🤯​M 🤯​M 🤯​M
🤯​ TestAccept/bundle/debug/fetch-repository-info/DMS=true 🤯​M 🤯​M ✅​p 🤯​M 🤯​M 🤯​M
🤯​ TestAccept/bundle/deploy/empty-bundle 🤯​M 🤯​M ✅​p 🤯​M 🤯​M 🤯​M
🤯​ TestAccept/bundle/deploy/empty-bundle/DATABRICKS_BUNDLE_ENABLE_EXPERIMENTAL_YAML_SYNC=/DMS= 🤯​M 🤯​M ✅​p 🤯​M 🤯​M 🤯​M
🤯​ TestAccept/bundle/deploy/empty-bundle/DATABRICKS_BUNDLE_ENABLE_EXPERIMENTAL_YAML_SYNC=/DMS=true 🤯​M 🤯​M ✅​p 🤯​M 🤯​M 🤯​M
🤯​ TestAccept/bundle/deploy/empty-bundle/DATABRICKS_BUNDLE_ENABLE_EXPERIMENTAL_YAML_SYNC=true/DMS= 🤯​M 🤯​M ✅​p 🤯​M 🤯​M 🤯​M
🤯​ TestAccept/bundle/deploy/empty-bundle/DATABRICKS_BUNDLE_ENABLE_EXPERIMENTAL_YAML_SYNC=true/DMS=true 🤯​M 🤯​M ✅​p 🤯​M 🤯​M 🤯​M
🤯​ TestAccept/bundle/deploy/files/no-snapshot-sync 🤯​M 🤯​M ✅​p 🤯​M 🤯​M 🤯​M
🤯​ TestAccept/bundle/deploy/files/no-snapshot-sync/DMS= 🤯​M 🤯​M ✅​p 🤯​M 🤯​M 🤯​M
🤯​ TestAccept/bundle/deploy/files/no-snapshot-sync/DMS=true 🤯​M 🤯​M ✅​p 🤯​M 🤯​M 🤯​M
🤯​ TestAccept/bundle/deploy/immutable/basic 🤯​M 🤯​M ✅​p 🤯​M 🤯​M 🤯​M
🤯​ TestAccept/bundle/deploy/immutable/basic/DMS= 🤯​M 🤯​M ✅​p 🤯​M 🤯​M 🤯​M
🤯​ TestAccept/bundle/deploy/immutable/breakglass 🤯​M 🤯​M ✅​p 🤯​M 🤯​M 🤯​M
🤯​ TestAccept/bundle/deploy/immutable/breakglass/DMS= 🤯​M 🤯​M ✅​p 🤯​M 🤯​M 🤯​M
🤯​ TestAccept/bundle/deploy/immutable/can-manage 🤯​M 🤯​M ✅​p 🤯​M 🤯​M 🤯​M
🤯​ TestAccept/bundle/deploy/immutable/can-manage/DMS= 🤯​M 🤯​M ✅​p 🤯​M 🤯​M 🤯​M
🤯​ TestAccept/bundle/deploy/immutable/destroy-redeploy 🤯​M 🤯​M ✅​p 🤯​M 🤯​M 🤯​M
🤯​ TestAccept/bundle/deploy/immutable/destroy-redeploy/DMS= 🤯​M 🤯​M ✅​p 🤯​M 🤯​M 🤯​M
🤯​ TestAccept/bundle/deploy/immutable/dev-mode 🤯​M 🤯​M ✅​p 🤯​M 🤯​M 🤯​M
🤯​ TestAccept/bundle/deploy/immutable/dev-mode/DMS= 🤯​M 🤯​M ✅​p 🤯​M 🤯​M 🤯​M
🤯​ TestAccept/bundle/deploy/immutable/legacy-state 🤯​M 🤯​M ✅​p ✅​p 🤯​M 🤯​M
🤯​ TestAccept/bundle/deploy/immutable/legacy-state/DMS= 🤯​M 🤯​M ✅​p ✅​p 🤯​M 🤯​M
🤯​ TestAccept/bundle/deploy/immutable/missing-snapshot 🤯​M 🤯​M ✅​p 🤯​M 🤯​M 🤯​M
🤯​ TestAccept/bundle/deploy/immutable/missing-snapshot/DMS= 🤯​M 🤯​M ✅​p 🤯​M 🤯​M 🤯​M
🤯​ TestAccept/bundle/deploy/immutable/no-artifacts 🤯​M 🤯​M ✅​p 🤯​M 🤯​M 🤯​M
🤯​ TestAccept/bundle/deploy/immutable/no-artifacts/DMS=/READPLAN= 🤯​M 🤯​M ✅​p 🤯​M 🤯​M 🤯​M
🤯​ TestAccept/bundle/deploy/immutable/no-artifacts/DMS=/READPLAN=1 🤯​M 🤯​M ✅​p 🤯​M 🤯​M 🤯​M
🤯​ TestAccept/bundle/deploy/immutable/permissions-change 🤯​M 🤯​M ✅​p 🤯​M 🤯​M 🤯​M
🤯​ TestAccept/bundle/deploy/immutable/permissions-change/DMS= 🤯​M 🤯​M ✅​p 🤯​M 🤯​M 🤯​M
🤯​ TestAccept/bundle/deploy/immutable/select 🤯​M 🤯​M ✅​p 🤯​M 🤯​M 🤯​M
🤯​ TestAccept/bundle/deploy/immutable/select/DMS= 🤯​M 🤯​M ✅​p 🤯​M 🤯​M 🤯​M
🤯​ TestAccept/bundle/deploy/mlops-stacks 🤯​M 🤯​M ✅​p 🤯​M 🤯​M 🤯​M
🤯​ TestAccept/bundle/deploy/mlops-stacks/DMS= 🤯​M 🤯​M ✅​p 🤯​M 🤯​M 🤯​M
🤯​ TestAccept/bundle/deploy/mlops-stacks/DMS=true 🤯​M 🤯​M ✅​p 🤯​M 🤯​M 🤯​M
🤯​ TestAccept/bundle/deploy/spark-jar-task 🤯​M 🤯​M ✅​p 🤯​M 🤯​M 🤯​M
🤯​ TestAccept/bundle/deploy/spark-jar-task/DMS= 🤯​M 🤯​M ✅​p 🤯​M 🤯​M 🤯​M
🤯​ TestAccept/bundle/deploy/spark-jar-task/DMS=true 🤯​M 🤯​M ✅​p 🤯​M 🤯​M 🤯​M
🤯​ TestAccept/bundle/deployment/bind/alert 🤯​M 🤯​M ✅​p 🤯​M 🤯​M 🤯​M
🤯​ TestAccept/bundle/deployment/bind/alert/DMS= 🤯​M 🤯​M ✅​p 🤯​M 🤯​M 🤯​M
🤯​ TestAccept/bundle/deployment/bind/alert/DMS=true 🤯​M 🤯​M ✅​p 🤯​M 🤯​M 🤯​M
🤯​ TestAccept/bundle/deployment/bind/catalog 🤯​M 🤯​M ✅​p 🤯​M 🤯​M 🤯​M
🤯​ TestAccept/bundle/deployment/bind/catalog/DMS= 🤯​M 🤯​M ✅​p 🤯​M 🤯​M 🤯​M
🤯​ TestAccept/bundle/deployment/bind/catalog/DMS=true 🤯​M 🤯​M ✅​p 🤯​M 🤯​M 🤯​M
🤯​ TestAccept/bundle/deployment/bind/cluster 🤯​M 🤯​M ✅​p 🤯​M 🤯​M 🤯​M
🤯​ TestAccept/bundle/deployment/bind/cluster/DMS= 🤯​M 🤯​M ✅​p 🤯​M 🤯​M 🤯​M
🤯​ TestAccept/bundle/deployment/bind/cluster/DMS=true 🤯​M 🤯​M ✅​p 🤯​M 🤯​M 🤯​M
🤯​ TestAccept/bundle/deployment/bind/dashboard 🤯​M 🤯​M ✅​p 🤯​M 🤯​M 🤯​M
🤯​ TestAccept/bundle/deployment/bind/dashboard/DMS=/READPLAN= 🤯​M 🤯​M ✅​p 🤯​M 🤯​M 🤯​M
🤯​ TestAccept/bundle/deployment/bind/dashboard/DMS=/READPLAN=1 🤯​M 🤯​M ✅​p 🤯​M 🤯​M 🤯​M
🤯​ TestAccept/bundle/deployment/bind/dashboard/DMS=true/READPLAN= 🤯​M 🤯​M ✅​p 🤯​M 🤯​M 🤯​M
🤯​ TestAccept/bundle/deployment/bind/dashboard/DMS=true/READPLAN=1 🤯​M 🤯​M ✅​p 🤯​M 🤯​M 🤯​M
🤯​ TestAccept/bundle/deployment/bind/dashboard/recreation 🤯​M 🤯​M ✅​p 🤯​M 🤯​M 🤯​M
🤯​ TestAccept/bundle/deployment/bind/dashboard/recreation/DMS=/READPLAN= 🤯​M 🤯​M ✅​p 🤯​M 🤯​M 🤯​M
🤯​ TestAccept/bundle/deployment/bind/dashboard/recreation/DMS=/READPLAN=1 🤯​M 🤯​M ✅​p 🤯​M 🤯​M 🤯​M
Top 50 slowest tests (at least 2 minutes):
duration env testname
15:41 aws-windows-latest-4core-16gb TestAccept/bundle/resources/clusters/lifecycle-started/DMS=
15:02 aws linux-2core-8gb TestAccept/bundle/resources/apps/lifecycle-started/DMS=true
14:05 gcp-windows-latest-4core-16gb TestAccept/bundle/resources/schemas/rename_then_change/DMS=true
13:44 aws linux-2core-8gb TestAccept/bundle/resources/apps/lifecycle-started/DMS=
12:48 azure linux-2core-8gb TestAccept/bundle/resources/apps/lifecycle-started/DMS=true
12:45 aws linux-2core-8gb TestAccept/bundle/resources/apps/lifecycle-started-omitted/DMS=true
12:41 aws linux-2core-8gb TestAccept/bundle/resources/clusters/lifecycle-started/DMS=true
12:16 aws-windows-latest-4core-16gb TestAccept/bundle/resources/apps/lifecycle-started/DMS=true
12:10 azure linux-2core-8gb TestAccept/bundle/resources/apps/lifecycle-started/DMS=
11:45 azure-windows-latest-4core-16gb TestAccept/bundle/resources/apps/lifecycle-started/DMS=true
11:34 gcp linux-2core-8gb TestAccept/bundle/resources/clusters/lifecycle-started-toggle/DMS=
11:17 aws linux-2core-8gb TestAccept/bundle/quiet-levels/DMS=
11:00 aws-windows-latest-4core-16gb TestAccept/bundle/resources/clusters/lifecycle-started/DMS=true
10:36 aws-windows-latest-4core-16gb TestAccept/bundle/resources/apps/lifecycle-started/DMS=
9:50 aws-windows-latest-4core-16gb TestAccept/bundle/resources/dashboards/change-serialized-dashboard/DMS=true/READPLAN=1
9:48 azure-windows-latest-4core-16gb TestAccept/pipelines/run/refresh-flags
9:39 aws linux-2core-8gb TestAccept/bundle/quiet-levels/DMS=true
9:34 azure-windows-latest-4core-16gb TestAccept/bundle/resources/apps/lifecycle-started/DMS=
9:33 azure linux-2core-8gb TestAccept/bundle/quiet-levels/DMS=true
9:33 gcp linux-2core-8gb TestAccept/bundle/templates/default-python/combinations/serverless/DLT=yes/DMS=/NBOOK=yes/PY=yes/READPLAN=
9:32 gcp linux-2core-8gb TestAccept/bundle/resources/materialization_sets/immutable/DMS=
9:21 gcp linux-2core-8gb TestAccept/bundle/resources/clusters/lifecycle-started/DMS=
9:21 aws linux-2core-8gb TestAccept/bundle/invariant/destroy_idempotent/DMS=/INPUT_CONFIG=cluster.yml.tmpl/READPLAN=
9:20 aws-windows-latest-4core-16gb TestAccept/bundle/resources/clusters/lifecycle-started-toggle/DMS=
9:20 gcp linux-2core-8gb TestAccept/bundle/resources/clusters/lifecycle-started/DMS=true
9:19 gcp-windows-latest-4core-16gb TestAccept/bundle/resources/clusters/lifecycle-started/DMS=true
9:16 aws linux-2core-8gb TestAccept/bundle/resources/clusters/lifecycle-started/DMS=
9:15 gcp linux-2core-8gb TestAccept/bundle/select/deletion/DMS=true
9:06 gcp-windows-latest-4core-16gb TestAccept/bundle/resources/clusters/lifecycle-started/DMS=
9:05 aws linux-2core-8gb TestAccept/bundle/resources/apps/lifecycle-started-toggle/DMS=true
8:54 azure linux-2core-8gb TestAccept/bundle/resources/apps/lifecycle-started-toggle/DMS=true
8:54 azure-windows-latest-4core-16gb TestAccept/bundle/resources/clusters/lifecycle-started/DMS=true
8:48 gcp-windows-latest-4core-16gb TestAccept/bundle/resources/apps/lifecycle-started/DMS=
8:46 gcp linux-2core-8gb TestAccept/bundle/resources/schemas/rename_then_change/DMS=
8:44 aws-windows-latest-4core-16gb TestAccept/bundle/resources/materialization_sets/immutable/DMS=
8:21 aws-windows-latest-4core-16gb TestAccept/bundle/resources/materialization_sets/batch/DMS=
8:14 gcp linux-2core-8gb TestAccept/bundle/resources/clusters/lifecycle-started-toggle/DMS=true
8:12 gcp linux-2core-8gb TestAccept/bundle/resources/clusters/deploy/local_ssd_count/DMS=
8:07 gcp-windows-latest-4core-16gb TestAccept/bundle/templates/default-python/combinations/classic/DLT=no/DMS=/NBOOK=yes/PY=yes/READPLAN=1
8:07 gcp linux-2core-8gb TestAccept/bundle/templates/default-python/combinations/serverless/DLT=no/DMS=/NBOOK=yes/PY=yes/READPLAN=1
8:06 aws-windows-latest-4core-16gb TestAccept/bundle/resources/dashboards/change-serialized-dashboard/DMS=true/READPLAN=
7:57 gcp linux-2core-8gb TestAccept/bundle/resources/materialization_sets/immutable/DMS=true
7:51 azure linux-2core-8gb TestAccept/bundle/quiet-levels/DMS=
7:49 azure linux-2core-8gb TestAccept/pipelines/run/refresh-flags
7:47 gcp-windows-latest-4core-16gb TestAccept/bundle/resources/schemas/rename_then_change/DMS=
7:45 aws linux-2core-8gb TestAccept/bundle/resources/clusters/lifecycle-started-toggle/DMS=true
7:44 aws linux-2core-8gb TestAccept/bundle/resources/clusters/lifecycle-started-toggle/DMS=
7:38 gcp-windows-latest-4core-16gb TestAccept/bundle/templates/default-python/combinations/serverless/DLT=yes/DMS=/NBOOK=no/PY=no/READPLAN=
7:33 gcp linux-2core-8gb TestAccept/bundle/templates/default-python/combinations/serverless/DLT=no/DMS=/NBOOK=no/PY=yes/READPLAN=
7:30 gcp-windows-latest-4core-16gb TestAccept/bundle/templates/default-python/combinations/classic/DLT=no/DMS=/NBOOK=yes/PY=yes/READPLAN=
(1199 table rows omitted to keep the report under 60000 bytes)

@denik denik added factory-generated and removed ai-auto Deprecated: use factory-generated instead. labels Nov 20, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

DABs DABs related issues factory-generated

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants