From 721fdf5cc2f25fbd826978acb14f1a2f614c391c Mon Sep 17 00:00:00 2001 From: Bhukya Date: Tue, 10 Nov 2026 10:07:43 +0000 Subject: [PATCH 1/6] Add the changelog entries for pipeline testing One fragment per user-visible behavior of the pipelines test command and the testing property of pipelines. Each links the PRs that add the behavior and this PR. Co-authored-by: Isaac --- .nextchanges/bundles/pipelines-testing-plan.md | 1 + .nextchanges/bundles/pipelines-testing.md | 1 + .nextchanges/cli/pipelines-test-junit.md | 1 + .nextchanges/cli/pipelines-test-results.md | 1 + .nextchanges/cli/pipelines-test-run-control.md | 1 + .nextchanges/cli/pipelines-test.md | 1 + 6 files changed, 6 insertions(+) create mode 100644 .nextchanges/bundles/pipelines-testing-plan.md create mode 100644 .nextchanges/bundles/pipelines-testing.md create mode 100644 .nextchanges/cli/pipelines-test-junit.md create mode 100644 .nextchanges/cli/pipelines-test-results.md create mode 100644 .nextchanges/cli/pipelines-test-run-control.md create mode 100644 .nextchanges/cli/pipelines-test.md diff --git a/.nextchanges/bundles/pipelines-testing-plan.md b/.nextchanges/bundles/pipelines-testing-plan.md new file mode 100644 index 00000000000..6d7b664d750 --- /dev/null +++ b/.nextchanges/bundles/pipelines-testing-plan.md @@ -0,0 +1 @@ +* With `DATABRICKS_BUNDLE_ENABLE_EXPERIMENTAL_PIPELINE_TESTING=true`, `bundle plan` shows a change to the `testing` property of a pipeline that was made outside the bundle, and `bundle deploy` undoes it. ([#7438](https://github.com/databricks/cli/pull/7438), [#7439](https://github.com/databricks/cli/pull/7439)) diff --git a/.nextchanges/bundles/pipelines-testing.md b/.nextchanges/bundles/pipelines-testing.md new file mode 100644 index 00000000000..28fce725932 --- /dev/null +++ b/.nextchanges/bundles/pipelines-testing.md @@ -0,0 +1 @@ +* Add the experimental `testing` property of pipelines, with the test sources and test-only dependencies that `databricks pipelines test` runs with. It needs `DATABRICKS_BUNDLE_ENABLE_EXPERIMENTAL_PIPELINE_TESTING=true`. ([#7300](https://github.com/databricks/cli/pull/7300), [#7437](https://github.com/databricks/cli/pull/7437), [#7439](https://github.com/databricks/cli/pull/7439)) diff --git a/.nextchanges/cli/pipelines-test-junit.md b/.nextchanges/cli/pipelines-test-junit.md new file mode 100644 index 00000000000..ce616ad8e01 --- /dev/null +++ b/.nextchanges/cli/pipelines-test-junit.md @@ -0,0 +1 @@ +* Add `--junit-xml` to `databricks pipelines test`, which writes the results of the test run to a JUnit XML report. ([#7299](https://github.com/databricks/cli/pull/7299), [#7434](https://github.com/databricks/cli/pull/7434), [#7439](https://github.com/databricks/cli/pull/7439)) diff --git a/.nextchanges/cli/pipelines-test-results.md b/.nextchanges/cli/pipelines-test-results.md new file mode 100644 index 00000000000..d64ed1c7392 --- /dev/null +++ b/.nextchanges/cli/pipelines-test-results.md @@ -0,0 +1 @@ +* `databricks pipelines test` waits for the test run and prints the result of each test and a summary. `--no-wait` returns after the run starts. ([#7432](https://github.com/databricks/cli/pull/7432), [#7433](https://github.com/databricks/cli/pull/7433), [#7298](https://github.com/databricks/cli/pull/7298), [#7439](https://github.com/databricks/cli/pull/7439)) diff --git a/.nextchanges/cli/pipelines-test-run-control.md b/.nextchanges/cli/pipelines-test-run-control.md new file mode 100644 index 00000000000..be2d30d087b --- /dev/null +++ b/.nextchanges/cli/pipelines-test-run-control.md @@ -0,0 +1 @@ +* Add `--resume` and `--timeout` to `databricks pipelines test`. `--resume` reads the results of an earlier test run without starting a new one. ([#7426](https://github.com/databricks/cli/pull/7426), [#7439](https://github.com/databricks/cli/pull/7439)) diff --git a/.nextchanges/cli/pipelines-test.md b/.nextchanges/cli/pipelines-test.md new file mode 100644 index 00000000000..d0bbcff9630 --- /dev/null +++ b/.nextchanges/cli/pipelines-test.md @@ -0,0 +1 @@ +* Add the experimental `databricks pipelines test` command. It runs the tests of a pipeline in a test-only update, for a bundle pipeline by its KEY or for any pipeline by `--pipeline-id`. It needs `DATABRICKS_CLI_PIPELINES_TEST=true`. ([#7297](https://github.com/databricks/cli/pull/7297), [#7431](https://github.com/databricks/cli/pull/7431), [#7439](https://github.com/databricks/cli/pull/7439)) From e733a8e6ab854243c47e232eaabbc5cf09e6dd85 Mon Sep 17 00:00:00 2001 From: Bhukya Date: Mon, 16 Nov 2026 23:56:30 +0000 Subject: [PATCH 2/6] Keep only the changelog entries of merged and stacked PRs The entries for the results output, --resume and --timeout, and --junit-xml move to the PRs that add them, so that the release notes do not name features before they merge. The entry for the testing property says that everyone who deploys the bundle needs this CLI, because a deploy from an older CLI that changes the pipeline removes its testing. Co-authored-by: Isaac --- .nextchanges/bundles/pipelines-testing.md | 2 +- .nextchanges/cli/pipelines-test-junit.md | 1 - .nextchanges/cli/pipelines-test-results.md | 1 - .nextchanges/cli/pipelines-test-run-control.md | 1 - 4 files changed, 1 insertion(+), 4 deletions(-) delete mode 100644 .nextchanges/cli/pipelines-test-junit.md delete mode 100644 .nextchanges/cli/pipelines-test-results.md delete mode 100644 .nextchanges/cli/pipelines-test-run-control.md diff --git a/.nextchanges/bundles/pipelines-testing.md b/.nextchanges/bundles/pipelines-testing.md index 28fce725932..403006ce99e 100644 --- a/.nextchanges/bundles/pipelines-testing.md +++ b/.nextchanges/bundles/pipelines-testing.md @@ -1 +1 @@ -* Add the experimental `testing` property of pipelines, with the test sources and test-only dependencies that `databricks pipelines test` runs with. It needs `DATABRICKS_BUNDLE_ENABLE_EXPERIMENTAL_PIPELINE_TESTING=true`. ([#7300](https://github.com/databricks/cli/pull/7300), [#7437](https://github.com/databricks/cli/pull/7437), [#7439](https://github.com/databricks/cli/pull/7439)) +* Add the experimental `testing` property of pipelines, with the test sources and test-only dependencies that `databricks pipelines test` runs with. It needs `DATABRICKS_BUNDLE_ENABLE_EXPERIMENTAL_PIPELINE_TESTING=true`. Everyone who deploys the bundle needs this CLI version with the variable set: a deploy from an older CLI that changes the pipeline removes its `testing`. ([#7300](https://github.com/databricks/cli/pull/7300), [#7437](https://github.com/databricks/cli/pull/7437), [#7439](https://github.com/databricks/cli/pull/7439)) diff --git a/.nextchanges/cli/pipelines-test-junit.md b/.nextchanges/cli/pipelines-test-junit.md deleted file mode 100644 index ce616ad8e01..00000000000 --- a/.nextchanges/cli/pipelines-test-junit.md +++ /dev/null @@ -1 +0,0 @@ -* Add `--junit-xml` to `databricks pipelines test`, which writes the results of the test run to a JUnit XML report. ([#7299](https://github.com/databricks/cli/pull/7299), [#7434](https://github.com/databricks/cli/pull/7434), [#7439](https://github.com/databricks/cli/pull/7439)) diff --git a/.nextchanges/cli/pipelines-test-results.md b/.nextchanges/cli/pipelines-test-results.md deleted file mode 100644 index d64ed1c7392..00000000000 --- a/.nextchanges/cli/pipelines-test-results.md +++ /dev/null @@ -1 +0,0 @@ -* `databricks pipelines test` waits for the test run and prints the result of each test and a summary. `--no-wait` returns after the run starts. ([#7432](https://github.com/databricks/cli/pull/7432), [#7433](https://github.com/databricks/cli/pull/7433), [#7298](https://github.com/databricks/cli/pull/7298), [#7439](https://github.com/databricks/cli/pull/7439)) diff --git a/.nextchanges/cli/pipelines-test-run-control.md b/.nextchanges/cli/pipelines-test-run-control.md deleted file mode 100644 index be2d30d087b..00000000000 --- a/.nextchanges/cli/pipelines-test-run-control.md +++ /dev/null @@ -1 +0,0 @@ -* Add `--resume` and `--timeout` to `databricks pipelines test`. `--resume` reads the results of an earlier test run without starting a new one. ([#7426](https://github.com/databricks/cli/pull/7426), [#7439](https://github.com/databricks/cli/pull/7439)) From 8ebca4758a0a40686559606364823e8cdcb547df Mon Sep 17 00:00:00 2001 From: Bhukya Date: Tue, 17 Nov 2026 08:16:52 +0000 Subject: [PATCH 3/6] Add the changelog entries of the pipelines test results, run control and JUnit PRs They move here from #7298, #7426 and #7434, so that all pipeline testing entries are in one PR. Co-authored-by: Isaac --- .nextchanges/cli/pipelines-test-junit.md | 1 + .nextchanges/cli/pipelines-test-results.md | 1 + .nextchanges/cli/pipelines-test-run-control.md | 1 + 3 files changed, 3 insertions(+) create mode 100644 .nextchanges/cli/pipelines-test-junit.md create mode 100644 .nextchanges/cli/pipelines-test-results.md create mode 100644 .nextchanges/cli/pipelines-test-run-control.md diff --git a/.nextchanges/cli/pipelines-test-junit.md b/.nextchanges/cli/pipelines-test-junit.md new file mode 100644 index 00000000000..85324e7a638 --- /dev/null +++ b/.nextchanges/cli/pipelines-test-junit.md @@ -0,0 +1 @@ +* Add `--junit-xml` to `databricks pipelines test`, which writes the results of the test run to a JUnit XML report. ([#7299](https://github.com/databricks/cli/pull/7299), [#7434](https://github.com/databricks/cli/pull/7434)) diff --git a/.nextchanges/cli/pipelines-test-results.md b/.nextchanges/cli/pipelines-test-results.md new file mode 100644 index 00000000000..c06ea5d3b17 --- /dev/null +++ b/.nextchanges/cli/pipelines-test-results.md @@ -0,0 +1 @@ +* `databricks pipelines test` waits for the test run and prints the result of each test and a summary. `--no-wait` returns after the run starts. ([#7432](https://github.com/databricks/cli/pull/7432), [#7433](https://github.com/databricks/cli/pull/7433), [#7298](https://github.com/databricks/cli/pull/7298)) diff --git a/.nextchanges/cli/pipelines-test-run-control.md b/.nextchanges/cli/pipelines-test-run-control.md new file mode 100644 index 00000000000..37c5c0c1809 --- /dev/null +++ b/.nextchanges/cli/pipelines-test-run-control.md @@ -0,0 +1 @@ +* Add `--resume` and `--timeout` to `databricks pipelines test`. `--resume` reads the results of an earlier test run without starting a new one. ([#7426](https://github.com/databricks/cli/pull/7426)) From c51298cca4a75ba0dcffa7147f74f3f7ec8e2f97 Mon Sep 17 00:00:00 2001 From: Bhukya Date: Tue, 17 Nov 2026 08:34:10 +0000 Subject: [PATCH 4/6] Link the changelog PR from the moved changelog entries The changelog check requires each entry to link the PR that adds it. Co-authored-by: Isaac --- .nextchanges/cli/pipelines-test-junit.md | 2 +- .nextchanges/cli/pipelines-test-results.md | 2 +- .nextchanges/cli/pipelines-test-run-control.md | 2 +- 3 files changed, 3 insertions(+), 3 deletions(-) diff --git a/.nextchanges/cli/pipelines-test-junit.md b/.nextchanges/cli/pipelines-test-junit.md index 85324e7a638..ce616ad8e01 100644 --- a/.nextchanges/cli/pipelines-test-junit.md +++ b/.nextchanges/cli/pipelines-test-junit.md @@ -1 +1 @@ -* Add `--junit-xml` to `databricks pipelines test`, which writes the results of the test run to a JUnit XML report. ([#7299](https://github.com/databricks/cli/pull/7299), [#7434](https://github.com/databricks/cli/pull/7434)) +* Add `--junit-xml` to `databricks pipelines test`, which writes the results of the test run to a JUnit XML report. ([#7299](https://github.com/databricks/cli/pull/7299), [#7434](https://github.com/databricks/cli/pull/7434), [#7439](https://github.com/databricks/cli/pull/7439)) diff --git a/.nextchanges/cli/pipelines-test-results.md b/.nextchanges/cli/pipelines-test-results.md index c06ea5d3b17..d64ed1c7392 100644 --- a/.nextchanges/cli/pipelines-test-results.md +++ b/.nextchanges/cli/pipelines-test-results.md @@ -1 +1 @@ -* `databricks pipelines test` waits for the test run and prints the result of each test and a summary. `--no-wait` returns after the run starts. ([#7432](https://github.com/databricks/cli/pull/7432), [#7433](https://github.com/databricks/cli/pull/7433), [#7298](https://github.com/databricks/cli/pull/7298)) +* `databricks pipelines test` waits for the test run and prints the result of each test and a summary. `--no-wait` returns after the run starts. ([#7432](https://github.com/databricks/cli/pull/7432), [#7433](https://github.com/databricks/cli/pull/7433), [#7298](https://github.com/databricks/cli/pull/7298), [#7439](https://github.com/databricks/cli/pull/7439)) diff --git a/.nextchanges/cli/pipelines-test-run-control.md b/.nextchanges/cli/pipelines-test-run-control.md index 37c5c0c1809..be2d30d087b 100644 --- a/.nextchanges/cli/pipelines-test-run-control.md +++ b/.nextchanges/cli/pipelines-test-run-control.md @@ -1 +1 @@ -* Add `--resume` and `--timeout` to `databricks pipelines test`. `--resume` reads the results of an earlier test run without starting a new one. ([#7426](https://github.com/databricks/cli/pull/7426)) +* Add `--resume` and `--timeout` to `databricks pipelines test`. `--resume` reads the results of an earlier test run without starting a new one. ([#7426](https://github.com/databricks/cli/pull/7426), [#7439](https://github.com/databricks/cli/pull/7439)) From 35914904b1c4163307b56670cd5a753b0e8eed5b Mon Sep 17 00:00:00 2001 From: Bhukya Date: Tue, 17 Nov 2026 10:04:09 +0000 Subject: [PATCH 5/6] Drop the experimental gate from the pipelines test changelog entry The gate is removed in #7715. Co-authored-by: Isaac --- .nextchanges/cli/pipelines-test.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/.nextchanges/cli/pipelines-test.md b/.nextchanges/cli/pipelines-test.md index d0bbcff9630..97b89bfa1a4 100644 --- a/.nextchanges/cli/pipelines-test.md +++ b/.nextchanges/cli/pipelines-test.md @@ -1 +1 @@ -* Add the experimental `databricks pipelines test` command. It runs the tests of a pipeline in a test-only update, for a bundle pipeline by its KEY or for any pipeline by `--pipeline-id`. It needs `DATABRICKS_CLI_PIPELINES_TEST=true`. ([#7297](https://github.com/databricks/cli/pull/7297), [#7431](https://github.com/databricks/cli/pull/7431), [#7439](https://github.com/databricks/cli/pull/7439)) +* Add the `databricks pipelines test` command. It runs the tests of a pipeline in a test-only update, for a bundle pipeline by its KEY or for any pipeline by `--pipeline-id`. ([#7297](https://github.com/databricks/cli/pull/7297), [#7431](https://github.com/databricks/cli/pull/7431), [#7439](https://github.com/databricks/cli/pull/7439), [#7715](https://github.com/databricks/cli/pull/7715)) From fe6819a48931e99fba4633ffc44be0d5875b6a64 Mon Sep 17 00:00:00 2001 From: Bhukya Date: Tue, 17 Nov 2026 15:55:28 +0000 Subject: [PATCH 6/6] Drop the bundle testing variable from the changelog entries Co-authored-by: Isaac --- .nextchanges/bundles/pipelines-testing-plan.md | 2 +- .nextchanges/bundles/pipelines-testing.md | 2 +- 2 files changed, 2 insertions(+), 2 deletions(-) diff --git a/.nextchanges/bundles/pipelines-testing-plan.md b/.nextchanges/bundles/pipelines-testing-plan.md index 6d7b664d750..fa1b1d405bc 100644 --- a/.nextchanges/bundles/pipelines-testing-plan.md +++ b/.nextchanges/bundles/pipelines-testing-plan.md @@ -1 +1 @@ -* With `DATABRICKS_BUNDLE_ENABLE_EXPERIMENTAL_PIPELINE_TESTING=true`, `bundle plan` shows a change to the `testing` property of a pipeline that was made outside the bundle, and `bundle deploy` undoes it. ([#7438](https://github.com/databricks/cli/pull/7438), [#7439](https://github.com/databricks/cli/pull/7439)) +* `bundle plan` shows a change to the `testing` property of a pipeline that was made outside the bundle, and `bundle deploy` undoes it. ([#7438](https://github.com/databricks/cli/pull/7438), [#7439](https://github.com/databricks/cli/pull/7439)) diff --git a/.nextchanges/bundles/pipelines-testing.md b/.nextchanges/bundles/pipelines-testing.md index 403006ce99e..ddab4c4c865 100644 --- a/.nextchanges/bundles/pipelines-testing.md +++ b/.nextchanges/bundles/pipelines-testing.md @@ -1 +1 @@ -* Add the experimental `testing` property of pipelines, with the test sources and test-only dependencies that `databricks pipelines test` runs with. It needs `DATABRICKS_BUNDLE_ENABLE_EXPERIMENTAL_PIPELINE_TESTING=true`. Everyone who deploys the bundle needs this CLI version with the variable set: a deploy from an older CLI that changes the pipeline removes its `testing`. ([#7300](https://github.com/databricks/cli/pull/7300), [#7437](https://github.com/databricks/cli/pull/7437), [#7439](https://github.com/databricks/cli/pull/7439)) +* Add the `testing` property of pipelines, with the test sources and test-only dependencies that `databricks pipelines test` runs with. With `dynamic_version`, test dependencies use the patched wheel. Everyone who deploys the bundle needs this CLI version: a deploy from an older CLI that changes the pipeline removes its `testing`. ([#7300](https://github.com/databricks/cli/pull/7300), [#7437](https://github.com/databricks/cli/pull/7437), [#7439](https://github.com/databricks/cli/pull/7439))