Skip to content

Print test progress and results - #7433

Merged
tharunbhuk-db merged 1 commit into
mainfrom
tharun/pipelines-test-print-results
Nov 17, 2026
Merged

tharunbhuk-db merged 1 commit into
mainfrom
tharun/pipelines-test-print-results

Conversation

@tharunbhuk-db

@tharunbhuk-db tharunbhuk-db commented Nov 10, 2026 •

Copy link
Copy Markdown
Contributor

🥞 Stacked PR


  • Print test results: <i> of <n> <STATUS> <test ID> ....... [<STATUS> in <s>s], failure details, and a last line Done. PASSED=… TOTAL=….
  • Not used by the command yet.

Tests: unit tests.

This pull request and its description were written by Isaac.

@tharunbhuk-db
tharunbhuk-db force-pushed the tharun/pipelines-test-read-events branch from 2f0154d to 1154b5d Compare November 10, 2026 06:02
@tharunbhuk-db
tharunbhuk-db force-pushed the tharun/pipelines-test-print-results branch from 1b4c54c to 8329c9f Compare November 10, 2026 06:15
@tharunbhuk-db
tharunbhuk-db marked this pull request as ready for review November 10, 2026 06:19
@tharunbhuk-db
tharunbhuk-db requested review from a team as code owners November 10, 2026 06:19
@tharunbhuk-db
tharunbhuk-db requested review from shreyas-goenka and removed request for a team and shreyas-goenka November 10, 2026 06:19
@tharunbhuk-db tharunbhuk-db changed the title Print test progress and results like dbt test Print test progress and results Nov 10, 2026
@tharunbhuk-db
tharunbhuk-db force-pushed the tharun/pipelines-test-print-results branch from 8329c9f to 2036088 Compare November 10, 2026 06:25
@tharunbhuk-db
tharunbhuk-db force-pushed the tharun/pipelines-test-read-events branch from 1154b5d to 53b3c58 Compare November 10, 2026 17:13
@tharunbhuk-db
tharunbhuk-db force-pushed the tharun/pipelines-test-print-results branch from 2036088 to 42a9409 Compare November 10, 2026 17:13

@pranshupand-db pranshupand-db left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM. Follow-ups for the stack are in the #7297 review: #7297

idelafuente-oc pushed a commit to idelafuente-oc/cli that referenced this pull request Nov 11, 2026
## 🥞 Stacked PR
Use this [link](https://github.com/databricks/cli/pull/7297/files) to
review incremental changes.
-
[**stack/pipelines-test-pr1-command**](databricks#7297)
[[Files changed](https://github.com/databricks/cli/pull/7297/files)] ←
_this PR_
-
[stack/pipelines-test-bundle-key](databricks#7431)
[[Files changed](https://github.com/databricks/cli/pull/7431/files)]
-
[stack/pipelines-test-read-events](databricks#7432)
[[Files changed](https://github.com/databricks/cli/pull/7432/files)]
-
[stack/pipelines-test-print-results](databricks#7433)
[[Files changed](https://github.com/databricks/cli/pull/7433/files)]
-
[stack/pipelines-test-pr2-output](databricks#7298)
[[Files changed](https://github.com/databricks/cli/pull/7298/files)]
-
[stack/pipelines-test-a4-run-control](databricks#7426)
[[Files changed](https://github.com/databricks/cli/pull/7426/files)]
-
[stack/pipelines-test-pr3-junit](databricks#7299)
[[Files changed](https://github.com/databricks/cli/pull/7299/files)]
-
[stack/pipelines-test-junit-flag](databricks#7434)
[[Files changed](https://github.com/databricks/cli/pull/7434/files)]

---------
- Add `databricks pipelines test --pipeline-id <id>
[TEST_SELECTION...]`: starts a test-only update and prints its IDs.
- Experimental: runs only with `DATABRICKS_CLI_PIPELINES_TEST=true`.
- Selections are workspace paths or paths relative to `root_path`, sent
as typed. `--pytest-arg` accepts only `-k` and `-m`.

Tests: unit tests; acceptance in
`acceptance/pipelines/test/{arguments,pipeline-id,submit-error}`.

This pull request and its description were written by Isaac.

Co-authored-by: Isaac <no-reply@databricks.com>
idelafuente-oc pushed a commit to idelafuente-oc/cli that referenced this pull request Nov 11, 2026
## 🥞 Stacked PR
-
[stack/pipelines-test-pr1-command](databricks#7297)
[[Files changed](https://github.com/databricks/cli/pull/7297/files)]
-
[**stack/pipelines-test-bundle-key**](databricks#7431)
[[Files changed](https://github.com/databricks/cli/pull/7431/files)] ←
_this PR_
-
[stack/pipelines-test-read-events](databricks#7432)
[[Files changed](https://github.com/databricks/cli/pull/7432/files)]
-
[stack/pipelines-test-print-results](databricks#7433)
[[Files changed](https://github.com/databricks/cli/pull/7433/files)]
-
[stack/pipelines-test-pr2-output](databricks#7298)
[[Files changed](https://github.com/databricks/cli/pull/7298/files)]
-
[stack/pipelines-test-a4-run-control](databricks#7426)
[[Files changed](https://github.com/databricks/cli/pull/7426/files)]
-
[stack/pipelines-test-pr3-junit](databricks#7299)
[[Files changed](https://github.com/databricks/cli/pull/7299/files)]
-
[stack/pipelines-test-junit-flag](databricks#7434)
[[Files changed](https://github.com/databricks/cli/pull/7434/files)]

---------
- In a bundle, identify the pipeline by KEY: `pipelines test [flags]
[KEY] [TEST_SELECTION...]`.
- Relative selections are local paths, mapped to their deployed paths.
- A first argument that is not a KEY gets an error that names the
bundle's pipelines and the working command.

Tests: unit tests; acceptance in
`acceptance/pipelines/test/{selection,immutable}`.

This pull request and its description were written by Isaac.

Co-authored-by: Isaac <no-reply@databricks.com>
@tharunbhuk-db
tharunbhuk-db force-pushed the tharun/pipelines-test-read-events branch from 53b3c58 to 6203ea4 Compare November 16, 2026 22:19
@tharunbhuk-db
tharunbhuk-db force-pushed the tharun/pipelines-test-print-results branch from 42a9409 to 8ff858f Compare November 16, 2026 22:19
@tharunbhuk-db
tharunbhuk-db force-pushed the tharun/pipelines-test-read-events branch from 6203ea4 to c1a1613 Compare November 17, 2026 00:17
@tharunbhuk-db
tharunbhuk-db force-pushed the tharun/pipelines-test-print-results branch from 8ff858f to 40a204e Compare November 17, 2026 00:17
@tharunbhuk-db
tharunbhuk-db force-pushed the tharun/pipelines-test-print-results branch from 40a204e to f2268c2 Compare November 17, 2026 07:00
Base automatically changed from tharun/pipelines-test-read-events to main November 17, 2026 07:27
Each finished case prints "<i> of <n> <STATUS> <test ID>", padded with dots to
80 columns, then "[<STATUS> in <s>s]", so the statuses line up while each case
prints as it ends. After the run, the details of every failed or errored case
follow, then the reason for an incomplete run, and the run ends with
"Done. PASSED=… FAILED=… SKIPPED=… ERROR=… TOTAL=…". The command does not use
the printer yet.

Co-authored-by: Isaac <no-reply@databricks.com>
@tharunbhuk-db
tharunbhuk-db force-pushed the tharun/pipelines-test-print-results branch from f2268c2 to 6c5c865 Compare November 17, 2026 07:28
@tharunbhuk-db
tharunbhuk-db added this pull request to the merge queue Nov 17, 2026
Merged via the queue into main with commit 865ee2a Nov 17, 2026
24 checks passed
@tharunbhuk-db
tharunbhuk-db deleted the tharun/pipelines-test-print-results branch November 17, 2026 07:55
@eng-dev-ecosystem-bot

Copy link
Copy Markdown
Collaborator

❌ Integration test report

Commit: 865ee2a

Run: 44042581522

Env ❌​FAIL 🟨​KNOWN 💚​RECOVERED ✅​pass 🙈​skip Time
❌​ aws linux-2core-8gb 49 1 12 1573 1336 238:28
❌​ aws-windows-latest-4core-16gb 40 1 12 1501 1363 249:13
❌​ azure linux-2core-8gb 78 1 12 1524 1344 230:18
❌​ azure-windows-latest-4core-16gb 71 1 12 1450 1371 244:43
❌​ gcp linux-2core-8gb 38 3 10 1571 1342 268:48
❌​ gcp-windows-latest-4core-16gb 67 1 12 1461 1369 282:19
101 interesting tests: 88 FAIL, 10 RECOVERED, 3 KNOWN
Test Name aws linux-2core-8gb aws-windows-latest-4core-16gb azure linux-2core-8gb azure-windows-latest-4core-16gb gcp linux-2core-8gb gcp-windows-latest-4core-16gb
🟨​ TestAccept 🟨​K 🟨​K 🟨​K 🟨​K 🟨​K 🟨​K
❌​ TestAccept/bundle/config-remote-sync/cluster_policy_cross_target ❌​F 🙈​s ❌​F 🙈​s ❌​F 🙈​s
❌​ TestAccept/bundle/config-remote-sync/cluster_policy_cross_target/DMS= ❌​F ❌​F ❌​F
❌​ TestAccept/bundle/config-remote-sync/cluster_policy_cross_target/DMS=true ❌​F ❌​F ❌​F
❌​ TestAccept/bundle/config-remote-sync/cluster_policy_remote_addition ❌​F 🙈​s ❌​F 🙈​s ❌​F 🙈​s
❌​ TestAccept/bundle/config-remote-sync/cluster_policy_remote_addition/DMS= ❌​F ❌​F ❌​F
❌​ TestAccept/bundle/config-remote-sync/cluster_policy_remote_addition/DMS=true ❌​F ❌​F ❌​F
❌​ TestAccept/bundle/config-remote-sync/policy_injected_cluster_fields ❌​F 🙈​s ❌​F 🙈​s ❌​F 🙈​s
❌​ TestAccept/bundle/config-remote-sync/policy_injected_cluster_fields/DMS= ❌​F ❌​F ❌​F
❌​ TestAccept/bundle/config-remote-sync/policy_injected_cluster_fields/DMS=true ❌​F ❌​F ❌​F
❌​ TestAccept/bundle/deploy/spark-jar-task ❌​F ❌​F ❌​F ❌​F ❌​F ❌​F
❌​ TestAccept/bundle/deploy/spark-jar-task/DMS= ❌​F ❌​F ❌​F ❌​F ❌​F ❌​F
❌​ TestAccept/bundle/deploy/spark-jar-task/DMS=true ❌​F ❌​F ❌​F ❌​F ❌​F ❌​F
❌​ TestAccept/bundle/dms/depends-on ✅​p ✅​p ✅​p ✅​p ❌​F ✅​p
❌​ TestAccept/bundle/dms/depends-on/DMS=true ✅​p ✅​p ✅​p ✅​p ❌​F ✅​p
❌​ TestAccept/bundle/invariant/continue_293 ❌​F ❌​F ❌​F ❌​F ❌​F ❌​F
❌​ TestAccept/bundle/invariant/continue_293/DMS=/INPUT_CONFIG=cluster.yml.tmpl ❌​F ❌​F ❌​F ❌​F ❌​F ❌​F
❌​ TestAccept/bundle/invariant/continue_293/DMS=/INPUT_CONFIG=cluster_apply_policy_default_values.yml.tmpl ❌​F ❌​F ❌​F ❌​F ❌​F ❌​F
❌​ TestAccept/bundle/invariant/continue_293/DMS=/INPUT_CONFIG=job_apply_policy_default_values_for_each_task.yml.tmpl ❌​F ❌​F ❌​F ❌​F ❌​F ❌​F
❌​ TestAccept/bundle/invariant/continue_293/DMS=/INPUT_CONFIG=job_apply_policy_default_values_job_cluster.yml.tmpl ❌​F ❌​F ❌​F ❌​F ❌​F ❌​F
❌​ TestAccept/bundle/invariant/continue_293/DMS=/INPUT_CONFIG=job_apply_policy_default_values_task_cluster.yml.tmpl ❌​F ❌​F ❌​F ❌​F ❌​F ❌​F
❌​ TestAccept/bundle/invariant/continue_293/DMS=/INPUT_CONFIG=job_with_task.yml.tmpl ❌​F ❌​F ❌​F ❌​F ❌​F ❌​F
❌​ TestAccept/bundle/invariant/delete_idempotent ❌​F ❌​F ❌​F ❌​F ❌​F ❌​F
❌​ TestAccept/bundle/invariant/delete_idempotent/DMS=/INPUT_CONFIG=cluster.yml.tmpl/READPLAN= ❌​F ❌​F ❌​F ❌​F ❌​F ❌​F
❌​ TestAccept/bundle/invariant/delete_idempotent/DMS=/INPUT_CONFIG=cluster.yml.tmpl/READPLAN=1 ❌​F ❌​F ❌​F ❌​F ❌​F ❌​F
❌​ TestAccept/bundle/invariant/delete_idempotent/DMS=/INPUT_CONFIG=cluster_apply_policy_default_values.yml.tmpl/READPLAN= ❌​F ❌​F ❌​F ❌​F ❌​F ❌​F
❌​ TestAccept/bundle/invariant/delete_idempotent/DMS=/INPUT_CONFIG=cluster_apply_policy_default_values.yml.tmpl/READPLAN=1 ❌​F ❌​F ❌​F ❌​F ❌​F ❌​F
❌​ TestAccept/bundle/invariant/delete_idempotent/DMS=/INPUT_CONFIG=cluster_libraries.yml.tmpl/READPLAN= ❌​F ❌​F ❌​F ❌​F ❌​F ❌​F
❌​ TestAccept/bundle/invariant/delete_idempotent/DMS=/INPUT_CONFIG=cluster_libraries.yml.tmpl/READPLAN=1 ❌​F ❌​F ❌​F ❌​F ❌​F ❌​F
❌​ TestAccept/bundle/invariant/delete_idempotent/DMS=/INPUT_CONFIG=job_apply_policy_default_values_for_each_task.yml.tmpl/READPLAN= ❌​F ❌​F ❌​F ❌​F ❌​F ❌​F
❌​ TestAccept/bundle/invariant/delete_idempotent/DMS=/INPUT_CONFIG=job_apply_policy_default_values_for_each_task.yml.tmpl/READPLAN=1 ❌​F ❌​F ❌​F ❌​F ❌​F ❌​F
❌​ TestAccept/bundle/invariant/delete_idempotent/DMS=/INPUT_CONFIG=job_apply_policy_default_values_job_cluster.yml.tmpl/READPLAN= ❌​F ❌​F ❌​F ❌​F ❌​F ❌​F
❌​ TestAccept/bundle/invariant/delete_idempotent/DMS=/INPUT_CONFIG=job_apply_policy_default_values_job_cluster.yml.tmpl/READPLAN=1 ❌​F ❌​F ❌​F ❌​F ❌​F ❌​F
❌​ TestAccept/bundle/invariant/delete_idempotent/DMS=/INPUT_CONFIG=job_apply_policy_default_values_task_cluster.yml.tmpl/READPLAN= ❌​F ❌​F ❌​F ❌​F ❌​F ❌​F
❌​ TestAccept/bundle/invariant/delete_idempotent/DMS=/INPUT_CONFIG=job_apply_policy_default_values_task_cluster.yml.tmpl/READPLAN=1 ❌​F ❌​F ❌​F ❌​F ❌​F ❌​F
❌​ TestAccept/bundle/invariant/delete_idempotent/DMS=/INPUT_CONFIG=job_with_task.yml.tmpl/READPLAN= ❌​F ❌​F ❌​F ❌​F ❌​F ❌​F
❌​ TestAccept/bundle/invariant/delete_idempotent/DMS=/INPUT_CONFIG=job_with_task.yml.tmpl/READPLAN=1 ❌​F ❌​F ❌​F ❌​F ❌​F ❌​F
❌​ TestAccept/bundle/invariant/destroy_idempotent ❌​F ✅​p ❌​F ❌​F ✅​p ❌​F
❌​ TestAccept/bundle/invariant/destroy_idempotent/DMS=/INPUT_CONFIG=cluster.yml.tmpl/READPLAN= ❌​F ✅​p ❌​F ❌​F ✅​p ❌​F
❌​ TestAccept/bundle/invariant/destroy_idempotent/DMS=/INPUT_CONFIG=cluster.yml.tmpl/READPLAN=1 ❌​F ✅​p ❌​F ❌​F ✅​p ❌​F
❌​ TestAccept/bundle/invariant/destroy_idempotent/DMS=/INPUT_CONFIG=cluster_apply_policy_default_values.yml.tmpl/READPLAN= ❌​F ✅​p ❌​F ❌​F ✅​p ❌​F
❌​ TestAccept/bundle/invariant/destroy_idempotent/DMS=/INPUT_CONFIG=cluster_apply_policy_default_values.yml.tmpl/READPLAN=1 ❌​F ✅​p ❌​F ❌​F ✅​p ❌​F
❌​ TestAccept/bundle/invariant/destroy_idempotent/DMS=/INPUT_CONFIG=cluster_libraries.yml.tmpl/READPLAN= ❌​F ✅​p ❌​F ❌​F ✅​p ❌​F
❌​ TestAccept/bundle/invariant/destroy_idempotent/DMS=/INPUT_CONFIG=cluster_libraries.yml.tmpl/READPLAN=1 ❌​F ✅​p ❌​F ❌​F ✅​p ❌​F
❌​ TestAccept/bundle/invariant/destroy_idempotent/DMS=/INPUT_CONFIG=job_apply_policy_default_values_for_each_task.yml.tmpl/READPLAN= ❌​F ✅​p ❌​F ❌​F ✅​p ❌​F
❌​ TestAccept/bundle/invariant/destroy_idempotent/DMS=/INPUT_CONFIG=job_apply_policy_default_values_for_each_task.yml.tmpl/READPLAN=1 ❌​F ✅​p ❌​F ❌​F ✅​p ❌​F
❌​ TestAccept/bundle/invariant/destroy_idempotent/DMS=/INPUT_CONFIG=job_apply_policy_default_values_job_cluster.yml.tmpl/READPLAN= ❌​F ✅​p ❌​F ❌​F ✅​p ❌​F
❌​ TestAccept/bundle/invariant/destroy_idempotent/DMS=/INPUT_CONFIG=job_apply_policy_default_values_job_cluster.yml.tmpl/READPLAN=1 ❌​F ✅​p ❌​F ❌​F ✅​p ❌​F
❌​ TestAccept/bundle/invariant/destroy_idempotent/DMS=/INPUT_CONFIG=job_apply_policy_default_values_task_cluster.yml.tmpl/READPLAN= ❌​F ✅​p ❌​F ❌​F ✅​p ❌​F
❌​ TestAccept/bundle/invariant/destroy_idempotent/DMS=/INPUT_CONFIG=job_apply_policy_default_values_task_cluster.yml.tmpl/READPLAN=1 ❌​F ✅​p ❌​F ❌​F ✅​p ❌​F
❌​ TestAccept/bundle/invariant/destroy_idempotent/DMS=/INPUT_CONFIG=job_with_task.yml.tmpl/READPLAN= ✅​p ✅​p ❌​F ❌​F ✅​p ❌​F
❌​ TestAccept/bundle/invariant/destroy_idempotent/DMS=/INPUT_CONFIG=job_with_task.yml.tmpl/READPLAN=1 ✅​p ✅​p ❌​F ❌​F ✅​p ❌​F
❌​ TestAccept/bundle/invariant/no_drift ✅​p ❌​F ❌​F ❌​F ✅​p ❌​F
❌​ TestAccept/bundle/invariant/no_drift/DMS=/INPUT_CONFIG=cluster.yml.tmpl/READPLAN= ✅​p ❌​F ❌​F ❌​F ✅​p ❌​F
❌​ TestAccept/bundle/invariant/no_drift/DMS=/INPUT_CONFIG=cluster.yml.tmpl/READPLAN=1 ✅​p ❌​F ❌​F ❌​F ✅​p ❌​F
❌​ TestAccept/bundle/invariant/no_drift/DMS=/INPUT_CONFIG=cluster_apply_policy_default_values.yml.tmpl/READPLAN= ✅​p ❌​F ❌​F ❌​F ✅​p ❌​F
❌​ TestAccept/bundle/invariant/no_drift/DMS=/INPUT_CONFIG=cluster_apply_policy_default_values.yml.tmpl/READPLAN=1 ✅​p ❌​F ❌​F ❌​F ✅​p ❌​F
❌​ TestAccept/bundle/invariant/no_drift/DMS=/INPUT_CONFIG=cluster_libraries.yml.tmpl/READPLAN= ✅​p ❌​F ❌​F ❌​F ✅​p ❌​F
❌​ TestAccept/bundle/invariant/no_drift/DMS=/INPUT_CONFIG=cluster_libraries.yml.tmpl/READPLAN=1 ✅​p ❌​F ❌​F ❌​F ✅​p ❌​F
❌​ TestAccept/bundle/invariant/no_drift/DMS=/INPUT_CONFIG=job_apply_policy_default_values_for_each_task.yml.tmpl/READPLAN= ✅​p ❌​F ❌​F ❌​F ✅​p ❌​F
❌​ TestAccept/bundle/invariant/no_drift/DMS=/INPUT_CONFIG=job_apply_policy_default_values_for_each_task.yml.tmpl/READPLAN=1 ✅​p ❌​F ❌​F ❌​F ✅​p ❌​F
❌​ TestAccept/bundle/invariant/no_drift/DMS=/INPUT_CONFIG=job_apply_policy_default_values_job_cluster.yml.tmpl/READPLAN= ✅​p ❌​F ❌​F ❌​F ✅​p ❌​F
❌​ TestAccept/bundle/invariant/no_drift/DMS=/INPUT_CONFIG=job_apply_policy_default_values_job_cluster.yml.tmpl/READPLAN=1 ✅​p ❌​F ❌​F ❌​F ✅​p ❌​F
❌​ TestAccept/bundle/invariant/no_drift/DMS=/INPUT_CONFIG=job_apply_policy_default_values_task_cluster.yml.tmpl/READPLAN= ✅​p ❌​F ❌​F ❌​F ✅​p ❌​F
❌​ TestAccept/bundle/invariant/no_drift/DMS=/INPUT_CONFIG=job_apply_policy_default_values_task_cluster.yml.tmpl/READPLAN=1 ✅​p ❌​F ❌​F ❌​F ✅​p ❌​F
❌​ TestAccept/bundle/invariant/no_drift/DMS=/INPUT_CONFIG=job_with_task.yml.tmpl/READPLAN= ✅​p ❌​F ❌​F ❌​F ✅​p ❌​F
❌​ TestAccept/bundle/invariant/no_drift/DMS=/INPUT_CONFIG=job_with_task.yml.tmpl/READPLAN=1 ✅​p ❌​F ❌​F ❌​F ✅​p ❌​F
❌​ TestAccept/bundle/invariant/no_drift/DMS=true/INPUT_CONFIG=cluster.yml.tmpl/READPLAN= ✅​p ✅​p ❌​F ❌​F ✅​p ❌​F
❌​ TestAccept/bundle/invariant/no_drift/DMS=true/INPUT_CONFIG=cluster.yml.tmpl/READPLAN=1 ✅​p ✅​p ❌​F ❌​F ✅​p ❌​F
❌​ TestAccept/bundle/invariant/no_drift/DMS=true/INPUT_CONFIG=cluster_apply_policy_default_values.yml.tmpl/READPLAN= ✅​p ✅​p ❌​F ❌​F ✅​p ❌​F
❌​ TestAccept/bundle/invariant/no_drift/DMS=true/INPUT_CONFIG=cluster_apply_policy_default_values.yml.tmpl/READPLAN=1 ✅​p ✅​p ❌​F ❌​F ✅​p ❌​F
❌​ TestAccept/bundle/invariant/no_drift/DMS=true/INPUT_CONFIG=cluster_libraries.yml.tmpl/READPLAN= ✅​p ✅​p ❌​F ❌​F ✅​p ❌​F
❌​ TestAccept/bundle/invariant/no_drift/DMS=true/INPUT_CONFIG=cluster_libraries.yml.tmpl/READPLAN=1 ✅​p ✅​p ❌​F ❌​F ✅​p ❌​F
❌​ TestAccept/bundle/invariant/no_drift/DMS=true/INPUT_CONFIG=job_apply_policy_default_values_for_each_task.yml.tmpl/READPLAN= ✅​p ✅​p ❌​F ❌​F ✅​p ❌​F
❌​ TestAccept/bundle/invariant/no_drift/DMS=true/INPUT_CONFIG=job_apply_policy_default_values_for_each_task.yml.tmpl/READPLAN=1 ✅​p ✅​p ❌​F ❌​F ✅​p ❌​F
❌​ TestAccept/bundle/invariant/no_drift/DMS=true/INPUT_CONFIG=job_apply_policy_default_values_job_cluster.yml.tmpl/READPLAN= ✅​p ✅​p ❌​F ❌​F ✅​p ❌​F
❌​ TestAccept/bundle/invariant/no_drift/DMS=true/INPUT_CONFIG=job_apply_policy_default_values_job_cluster.yml.tmpl/READPLAN=1 ✅​p ✅​p ❌​F ❌​F ✅​p ❌​F
❌​ TestAccept/bundle/invariant/no_drift/DMS=true/INPUT_CONFIG=job_apply_policy_default_values_task_cluster.yml.tmpl/READPLAN= ✅​p ✅​p ❌​F ❌​F ✅​p ❌​F
❌​ TestAccept/bundle/invariant/no_drift/DMS=true/INPUT_CONFIG=job_apply_policy_default_values_task_cluster.yml.tmpl/READPLAN=1 ✅​p ✅​p ❌​F ❌​F ✅​p ❌​F
❌​ TestAccept/bundle/invariant/no_drift/DMS=true/INPUT_CONFIG=job_with_task.yml.tmpl/READPLAN= ✅​p ✅​p ✅​p ❌​F ✅​p ✅​p
❌​ TestAccept/bundle/invariant/no_drift/DMS=true/INPUT_CONFIG=job_with_task.yml.tmpl/READPLAN=1 ✅​p ✅​p ✅​p ❌​F ✅​p ✅​p
💚​ TestAccept/bundle/resources/apps/lifecycle-started 💚​R 💚​R 💚​R 💚​R 💚​R 💚​R
💚​ TestAccept/bundle/resources/apps/lifecycle-started-omitted 💚​R 💚​R 💚​R 💚​R 💚​R 💚​R
💚​ TestAccept/bundle/resources/apps/lifecycle-started-omitted/DMS= 💚​R 💚​R 💚​R 💚​R 💚​R 💚​R
💚​ TestAccept/bundle/resources/apps/lifecycle-started-omitted/DMS=true 💚​R 💚​R 💚​R 💚​R 💚​R 💚​R
💚​ TestAccept/bundle/resources/apps/lifecycle-started-toggle 💚​R 💚​R 💚​R 💚​R 💚​R 💚​R
💚​ TestAccept/bundle/resources/apps/lifecycle-started-toggle/DMS= 💚​R 💚​R 💚​R 💚​R 💚​R 💚​R
💚​ TestAccept/bundle/resources/apps/lifecycle-started-toggle/DMS=true 💚​R 💚​R 💚​R 💚​R 💚​R 💚​R
💚​ TestAccept/bundle/resources/apps/lifecycle-started/DMS= 💚​R 💚​R 💚​R 💚​R 💚​R 💚​R
💚​ TestAccept/bundle/resources/apps/lifecycle-started/DMS=true 💚​R 💚​R 💚​R 💚​R 💚​R 💚​R
❌​ TestAccept/bundle/resources/feature_specs/basic ✅​p ✅​p ✅​p ❌​F ✅​p ✅​p
❌​ TestAccept/bundle/resources/feature_specs/basic/DMS= ✅​p ✅​p ✅​p ❌​F ✅​p ✅​p
❌​ TestAccept/bundle/resources/postgres_databases/basic ✅​p ✅​p ✅​p ✅​p ❌​F ✅​p
❌​ TestAccept/bundle/resources/postgres_databases/basic/DMS=true ✅​p ✅​p ✅​p ✅​p ❌​F ✅​p
❌​ TestAccept/bundle/resources/postgres_projects/update_default_endpoint_autoscaling ❌​F ✅​p ✅​p ✅​p ✅​p ✅​p
❌​ TestAccept/bundle/resources/postgres_projects/update_default_endpoint_autoscaling/DMS=true ❌​F ✅​p ✅​p ✅​p ✅​p ✅​p
🟨​ TestAccept/bundle/resources/postgres_synced_tables/recreate 💚​R 💚​R 💚​R 💚​R 🟨​K 💚​R
💚​ TestAccept/bundle/resources/postgres_synced_tables/recreate/DMS= 💚​R 💚​R 💚​R 💚​R 💚​R 💚​R
🟨​ TestAccept/bundle/resources/postgres_synced_tables/recreate/DMS=true 💚​R 💚​R 💚​R 💚​R 🟨​K 💚​R
❌​ TestAccept/bundle/resources/registered_models/comment_cleared ✅​p ✅​p ❌​F ✅​p ✅​p ✅​p
❌​ TestAccept/bundle/resources/registered_models/comment_cleared/DMS=true ✅​p ✅​p ❌​F ✅​p ✅​p ✅​p
Top 50 slowest tests (at least 2 minutes):
duration env testname
11:45 gcp linux-2core-8gb TestAccept/bundle/resources/apps/lifecycle-started/DMS=true
10:07 aws linux-2core-8gb TestAccept/bundle/resources/apps/lifecycle-started/DMS=true
9:59 gcp linux-2core-8gb TestAccept/bundle/resources/apps/lifecycle-started/DMS=
9:51 aws-windows-latest-4core-16gb TestAccept/bundle/resources/apps/lifecycle-started/DMS=
9:38 aws-windows-latest-4core-16gb TestAccept/bundle/resources/apps/lifecycle-started/DMS=true
9:11 azure-windows-latest-4core-16gb TestAccept/bundle/resources/apps/lifecycle-started/DMS=
9:00 azure linux-2core-8gb TestAccept/bundle/resources/apps/lifecycle-started/DMS=
8:54 gcp linux-2core-8gb TestAccept/bundle/resources/clusters/deploy/local_ssd_count/DMS=
8:50 aws linux-2core-8gb TestAccept/bundle/resources/apps/lifecycle-started/DMS=
8:46 azure-windows-latest-4core-16gb TestAccept/bundle/resources/apps/lifecycle-started/DMS=true
8:45 gcp-windows-latest-4core-16gb TestAccept/bundle/resources/apps/lifecycle-started/DMS=true
8:34 azure linux-2core-8gb TestAccept/bundle/resources/apps/lifecycle-started/DMS=true
8:24 gcp-windows-latest-4core-16gb TestAccept/bundle/resources/apps/lifecycle-started/DMS=
7:47 gcp-windows-latest-4core-16gb TestAccept/bundle/resources/clusters/lifecycle-started/DMS=true
7:40 gcp-windows-latest-4core-16gb TestAccept/bundle/resources/clusters/deploy/local_ssd_count/DMS=true
7:28 gcp linux-2core-8gb TestAccept/bundle/resources/clusters/lifecycle-started/DMS=true
7:23 gcp linux-2core-8gb TestAccept/bundle/resources/clusters/lifecycle-started/DMS=
7:21 gcp-windows-latest-4core-16gb TestAccept/bundle/resources/clusters/lifecycle-started/DMS=
7:14 gcp linux-2core-8gb TestAccept/bundle/resources/clusters/deploy/local_ssd_count/DMS=true
7:00 gcp-windows-latest-4core-16gb TestAccept/bundle/resources/clusters/deploy/local_ssd_count/DMS=
6:56 azure linux-2core-8gb TestAccept/bundle/config-remote-sync/multiple_resources/DMS=true
6:45 aws linux-2core-8gb TestAccept/bundle/config-remote-sync/multiple_resources/DMS=true
6:28 aws linux-2core-8gb TestAccept/bundle/config-remote-sync/multiple_resources/DMS=
6:27 gcp-windows-latest-4core-16gb TestAccept/bundle/resources/clusters/lifecycle-started-toggle/DMS=true
6:26 aws-windows-latest-4core-16gb TestAccept/bundle/resources/clusters/lifecycle-started/DMS=
6:21 aws-windows-latest-4core-16gb TestAccept/bundle/resources/clusters/lifecycle-started-toggle/DMS=true
6:20 aws linux-2core-8gb TestAccept/bundle/resources/clusters/lifecycle-started/DMS=true
6:07 gcp linux-2core-8gb TestAccept/bundle/config-remote-sync/multiple_resources/DMS=
6:03 aws-windows-latest-4core-16gb TestAccept/bundle/resources/clusters/lifecycle-started/DMS=true
6:03 gcp linux-2core-8gb TestAccept/bundle/config-remote-sync/multiple_resources/DMS=true
5:47 gcp linux-2core-8gb TestAccept/bundle/resources/clusters/lifecycle-started-toggle/DMS=
5:42 gcp-windows-latest-4core-16gb TestAccept/bundle/resources/apps/lifecycle-started-omitted/DMS=
5:42 azure-windows-latest-4core-16gb TestAccept/bundle/resources/clusters/lifecycle-started/DMS=true
5:40 gcp linux-2core-8gb TestAccept/bundle/resources/schemas/rename_then_change/DMS=
5:38 gcp-windows-latest-4core-16gb TestAccept/bundle/resources/apps/lifecycle-started-toggle/DMS=true
5:37 gcp linux-2core-8gb TestAccept/bundle/templates/default-python/combinations/classic/DLT=yes/DMS=/NBOOK=no/PY=no/READPLAN=1
5:35 gcp linux-2core-8gb TestAccept/bundle/resources/clusters/lifecycle-started-toggle/DMS=true
5:33 aws linux-2core-8gb TestAccept/bundle/resources/clusters/lifecycle-started/DMS=
5:33 azure linux-2core-8gb TestAccept/bundle/config-remote-sync/multiple_resources/DMS=
5:27 azure linux-2core-8gb TestAccept/pipelines/run/refresh-flags
5:27 azure linux-2core-8gb TestAccept/bundle/resources/clusters/lifecycle-started/DMS=true
5:27 gcp-windows-latest-4core-16gb TestAccept/pipelines/run/refresh-flags
5:23 azure linux-2core-8gb TestAccept/bundle/resources/clusters/lifecycle-started-toggle/DMS=true
5:14 azure-windows-latest-4core-16gb TestAccept/bundle/resources/clusters/lifecycle-started/DMS=
5:11 gcp-windows-latest-4core-16gb TestAccept/bundle/resources/clusters/lifecycle-started-toggle/DMS=
4:55 azure-windows-latest-4core-16gb TestAccept/pipelines/run/refresh-flags
4:48 azure linux-2core-8gb TestAccept/bundle/resources/clusters/lifecycle-started/DMS=
4:48 gcp-windows-latest-4core-16gb TestAccept/bundle/resources/apps/lifecycle-started-omitted/DMS=true
4:40 gcp linux-2core-8gb TestAccept/bundle/templates/default-python/integration_classic/DMS=/UV_PYTHON=3.10
4:32 azure-windows-latest-4core-16gb TestAccept/bundle/resources/clusters/lifecycle-started-toggle/DMS=

idelafuente-oc pushed a commit to idelafuente-oc/cli that referenced this pull request Nov 20, 2026
## 🥞 Stacked PR
-
[stack/pipelines-test-pr1-command](databricks#7297)
[[Files changed](https://github.com/databricks/cli/pull/7297/files)]
-
[stack/pipelines-test-bundle-key](databricks#7431)
[[Files changed](https://github.com/databricks/cli/pull/7431/files)]
-
[**stack/pipelines-test-read-events**](databricks#7432)
[[Files changed](https://github.com/databricks/cli/pull/7432/files)] ←
_this PR_
-
[stack/pipelines-test-print-results](databricks#7433)
[[Files changed](https://github.com/databricks/cli/pull/7433/files)]
-
[stack/pipelines-test-pr2-output](databricks#7298)
[[Files changed](https://github.com/databricks/cli/pull/7298/files)]
-
[stack/pipelines-test-a4-run-control](databricks#7426)
[[Files changed](https://github.com/databricks/cli/pull/7426/files)]
-
[stack/pipelines-test-pr3-junit](databricks#7299)
[[Files changed](https://github.com/databricks/cli/pull/7299/files)]
-
[stack/pipelines-test-junit-flag](databricks#7434)
[[Files changed](https://github.com/databricks/cli/pull/7434/files)]

---------
- Read every page of an update's test events with the SDK's
`ListPipelineEventsRequest` and `buildPipelineEventFilter`. Existing
code is not changed.
- Collect one result per test case and check that the results are
complete.
- Not used by the command yet.
- Start test-only updates with `w.Pipelines.StartUpdate`: the Go SDK now
has `test_only` and `test_options`. The body has the same fields and
values; only the key order inside `test_options` follows the SDK type
(one golden file).
- The List Pipeline Events request stays a direct call: the SDK's
`PipelineEvent` has no `details` or `origin.test_case_id`, which the
test results come from.
- The short help says *Experimental*, like the long help and the gate. A
selection outside the synced files, and a relative selection with
`workspace.sync_mode: immutable`, now say which /Workspace path to pass.

Tests: unit tests, including 200 cases over 3 pages; acceptance
`pipelines/test/*`.

This pull request and its description were written by Isaac.

---------

Co-authored-by: Isaac <no-reply@databricks.com>
idelafuente-oc pushed a commit to idelafuente-oc/cli that referenced this pull request Nov 20, 2026
…ks#7298)

## 🥞 Stacked PR
-
[stack/pipelines-test-pr1-command](databricks#7297)
[[Files changed](https://github.com/databricks/cli/pull/7297/files)]
-
[stack/pipelines-test-bundle-key](databricks#7431)
[[Files changed](https://github.com/databricks/cli/pull/7431/files)]
-
[stack/pipelines-test-read-events](databricks#7432)
[[Files changed](https://github.com/databricks/cli/pull/7432/files)]
-
[stack/pipelines-test-print-results](databricks#7433)
[[Files changed](https://github.com/databricks/cli/pull/7433/files)]
-
[**stack/pipelines-test-pr2-output**](databricks#7298)
[[Files changed](https://github.com/databricks/cli/pull/7298/files)] ←
_this PR_
-
[stack/pipelines-test-a4-run-control](databricks#7426)
[[Files changed](https://github.com/databricks/cli/pull/7426/files)]
-
[stack/pipelines-test-pr3-junit](databricks#7299)
[[Files changed](https://github.com/databricks/cli/pull/7299/files)]
-
[stack/pipelines-test-junit-flag](databricks#7434)
[[Files changed](https://github.com/databricks/cli/pull/7434/files)]

---------
- Wait for the test update, print the results, and exit 0 only when at
least one test ran and none failed or errored.
- `--no-wait` returns after the update starts.
- The wait follows the bundle pipeline runner's loop.
- "No tests were collected" names the selection, or the pipeline's test
sources, and points to the `--pytest-arg` filters when they were given.
- The changelog entry for the results output is in this PR.

Tests: unit tests; acceptance in `acceptance/pipelines/test/results/*`,
with the service stubbed per case.

This pull request and its description were written by Isaac.

---------

Co-authored-by: Isaac <no-reply@databricks.com>
idelafuente-oc pushed a commit to idelafuente-oc/cli that referenced this pull request Nov 20, 2026
)

## 🥞 Stacked PR
-
[stack/pipelines-test-pr1-command](databricks#7297)
[[Files changed](https://github.com/databricks/cli/pull/7297/files)]
-
[stack/pipelines-test-bundle-key](databricks#7431)
[[Files changed](https://github.com/databricks/cli/pull/7431/files)]
-
[stack/pipelines-test-read-events](databricks#7432)
[[Files changed](https://github.com/databricks/cli/pull/7432/files)]
-
[stack/pipelines-test-print-results](databricks#7433)
[[Files changed](https://github.com/databricks/cli/pull/7433/files)]
-
[stack/pipelines-test-pr2-output](databricks#7298)
[[Files changed](https://github.com/databricks/cli/pull/7298/files)]
-
[**stack/pipelines-test-a4-run-control**](databricks#7426)
[[Files changed](https://github.com/databricks/cli/pull/7426/files)] ←
_this PR_
-
[stack/pipelines-test-pr3-junit](databricks#7299)
[[Files changed](https://github.com/databricks/cli/pull/7299/files)]
-
[stack/pipelines-test-junit-flag](databricks#7434)
[[Files changed](https://github.com/databricks/cli/pull/7434/files)]

---------
- `--timeout` and Ctrl+C stop the local wait and print the `--resume`
command; the update keeps running.
- `--resume <update-id>` reads an existing test update.
- A Ctrl+C during Start Update still prints the update ID; a second
Ctrl+C ends the process.
- `--resume` reads `test_only` with `w.Pipelines.GetUpdate`: the Go SDK
now has `UpdateInfo.test_only`. As before, only an explicit `test_only:
false` is rejected; an update without the field is accepted.
- A failed read of the update or its events ends with the `--resume`
command, as a timeout does. An incomplete result prints the `--resume`
command before the summary.
- When Start Update says an update is already active, the error says to
wait, to stop it (bundle pipelines), or to read it with `--resume`.
- The changelog entry for `--resume` and `--timeout` is in this PR.

Tests: unit tests; acceptance in
`acceptance/pipelines/test/run-control/*`.

This pull request and its description were written by Isaac.

---------

Co-authored-by: Isaac <no-reply@databricks.com>
idelafuente-oc pushed a commit to idelafuente-oc/cli that referenced this pull request Nov 20, 2026
)

## 🥞 Stacked PR
-
[stack/pipelines-test-pr1-command](databricks#7297)
[[Files changed](https://github.com/databricks/cli/pull/7297/files)]
-
[stack/pipelines-test-bundle-key](databricks#7431)
[[Files changed](https://github.com/databricks/cli/pull/7431/files)]
-
[stack/pipelines-test-read-events](databricks#7432)
[[Files changed](https://github.com/databricks/cli/pull/7432/files)]
-
[stack/pipelines-test-print-results](databricks#7433)
[[Files changed](https://github.com/databricks/cli/pull/7433/files)]
-
[stack/pipelines-test-pr2-output](databricks#7298)
[[Files changed](https://github.com/databricks/cli/pull/7298/files)]
-
[stack/pipelines-test-a4-run-control](databricks#7426)
[[Files changed](https://github.com/databricks/cli/pull/7426/files)]
-
[**stack/pipelines-test-pr3-junit**](databricks#7299)
[[Files changed](https://github.com/databricks/cli/pull/7299/files)] ←
_this PR_
-
[stack/pipelines-test-junit-flag](databricks#7434)
[[Files changed](https://github.com/databricks/cli/pull/7434/files)]

---------
- Build a JUnit XML report from a test run: one entry per case, plus a
failing entry for an incomplete run.
- The file is replaced atomically.
- Not used by the command yet.
- Every failing entry that the command adds is named `pipelines test`;
the update ID is in the entry's text.

Tests: unit tests.

This pull request and its description were written by Isaac.

---------

Co-authored-by: Isaac <no-reply@databricks.com>
idelafuente-oc pushed a commit to idelafuente-oc/cli that referenced this pull request Nov 20, 2026
)

## 🥞 Stacked PR
-
[stack/pipelines-test-pr1-command](databricks#7297)
[[Files changed](https://github.com/databricks/cli/pull/7297/files)]
-
[stack/pipelines-test-bundle-key](databricks#7431)
[[Files changed](https://github.com/databricks/cli/pull/7431/files)]
-
[stack/pipelines-test-read-events](databricks#7432)
[[Files changed](https://github.com/databricks/cli/pull/7432/files)]
-
[stack/pipelines-test-print-results](databricks#7433)
[[Files changed](https://github.com/databricks/cli/pull/7433/files)]
-
[stack/pipelines-test-pr2-output](databricks#7298)
[[Files changed](https://github.com/databricks/cli/pull/7298/files)]
-
[stack/pipelines-test-a4-run-control](databricks#7426)
[[Files changed](https://github.com/databricks/cli/pull/7426/files)]
-
[stack/pipelines-test-pr3-junit](databricks#7299)
[[Files changed](https://github.com/databricks/cli/pull/7299/files)]
-
[**stack/pipelines-test-junit-flag**](databricks#7434)
[[Files changed](https://github.com/databricks/cli/pull/7434/files)] ←
_this PR_

---------
- Add `--junit-xml <path>`, which writes the report on every exit after
the flags parse.
- The `JUnit report:` line prints before the summary line.
- The help has examples: all tests, one file, one test by ID, CI with
`--junit-xml`, `--timeout` then `--resume`, and `--pipeline-id`.
- The changelog entry for `--junit-xml` is in this PR.

Tests: acceptance reports (`out.*.xml`) in
`acceptance/pipelines/test/*`.

This pull request and its description were written by Isaac.

---------

Co-authored-by: Isaac <no-reply@databricks.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants