Repository navigation
Run a bundle pipeline's tests by its KEY - #7431
Merged
Merged
Conversation
This was referenced Nov 10, 2026
Contributor
|
Commit: Regression test reportSelected 4 changed tests (limit=20, 0 not selected) 4 tests: regression=4 unreleased=0 coverage=0 failing=0
TestAccept/pipelines/test/arguments: branch ✅ | main (b00fe63) ❌ | latest (v1.25.0) ❌main (b00fe63): latest (v1.25.0): TestAccept/pipelines/test/immutable: branch ✅ | main (b00fe63) ❌ | latest (v1.25.0) ❌main (b00fe63): latest (v1.25.0): TestAccept/pipelines/test/pipeline-id: branch ✅ | main (b00fe63) ❌ | latest (v1.25.0) ❌main (b00fe63): latest (v1.25.0): TestAccept/pipelines/test/selection: branch ✅ | main (b00fe63) ❌ | latest (v1.25.0) ❌main (b00fe63): latest (v1.25.0): |
tharunbhuk-db
marked this pull request as ready for review
November 10, 2026 05:45
tharunbhuk-db
requested review from
janniklasrose and
pranshupand-db
and removed request for
a team and
janniklasrose
November 10, 2026 05:45
tharunbhuk-db
force-pushed
the
tharun/pipelines-test-pr1-command
branch
from
November 10, 2026 17:13
4401851 to
9be85fd
Compare
tharunbhuk-db
force-pushed
the
tharun/pipelines-test-bundle-key
branch
from
November 10, 2026 17:13
3535b9a to
7d64487
Compare
pranshupand-db
approved these changes
Nov 10, 2026
In a bundle, the first argument is the pipeline KEY, and relative test selections are local paths that map to their deployed workspace paths. When the first argument is not a pipeline KEY, the error names the bundle's pipelines and shows the working command. Co-authored-by: Isaac <no-reply@databricks.com>
tharunbhuk-db
force-pushed
the
tharun/pipelines-test-bundle-key
branch
from
November 11, 2026 00:04
7d64487 to
2a9fc81
Compare
github-merge-queue
Bot
removed this pull request from the merge queue due to failed status checks
Nov 11, 2026
Collaborator
❌ Integration test reportCommit: ab02d65
10 interesting tests: 6 flaky, 4 FAIL
Top 50 slowest tests (at least 2 minutes):
|
idelafuente-oc
pushed a commit
to idelafuente-oc/cli
that referenced
this pull request
Nov 11, 2026
## 🥞 Stacked PR Use this [link](https://github.com/databricks/cli/pull/7297/files) to review incremental changes. - [**stack/pipelines-test-pr1-command**](databricks#7297) [[Files changed](https://github.com/databricks/cli/pull/7297/files)] ← _this PR_ - [stack/pipelines-test-bundle-key](databricks#7431) [[Files changed](https://github.com/databricks/cli/pull/7431/files)] - [stack/pipelines-test-read-events](databricks#7432) [[Files changed](https://github.com/databricks/cli/pull/7432/files)] - [stack/pipelines-test-print-results](databricks#7433) [[Files changed](https://github.com/databricks/cli/pull/7433/files)] - [stack/pipelines-test-pr2-output](databricks#7298) [[Files changed](https://github.com/databricks/cli/pull/7298/files)] - [stack/pipelines-test-a4-run-control](databricks#7426) [[Files changed](https://github.com/databricks/cli/pull/7426/files)] - [stack/pipelines-test-pr3-junit](databricks#7299) [[Files changed](https://github.com/databricks/cli/pull/7299/files)] - [stack/pipelines-test-junit-flag](databricks#7434) [[Files changed](https://github.com/databricks/cli/pull/7434/files)] --------- - Add `databricks pipelines test --pipeline-id <id> [TEST_SELECTION...]`: starts a test-only update and prints its IDs. - Experimental: runs only with `DATABRICKS_CLI_PIPELINES_TEST=true`. - Selections are workspace paths or paths relative to `root_path`, sent as typed. `--pytest-arg` accepts only `-k` and `-m`. Tests: unit tests; acceptance in `acceptance/pipelines/test/{arguments,pipeline-id,submit-error}`. This pull request and its description were written by Isaac. Co-authored-by: Isaac <no-reply@databricks.com>
idelafuente-oc
pushed a commit
to idelafuente-oc/cli
that referenced
this pull request
Nov 20, 2026
## 🥞 Stacked PR - [stack/pipelines-test-pr1-command](databricks#7297) [[Files changed](https://github.com/databricks/cli/pull/7297/files)] - [stack/pipelines-test-bundle-key](databricks#7431) [[Files changed](https://github.com/databricks/cli/pull/7431/files)] - [**stack/pipelines-test-read-events**](databricks#7432) [[Files changed](https://github.com/databricks/cli/pull/7432/files)] ← _this PR_ - [stack/pipelines-test-print-results](databricks#7433) [[Files changed](https://github.com/databricks/cli/pull/7433/files)] - [stack/pipelines-test-pr2-output](databricks#7298) [[Files changed](https://github.com/databricks/cli/pull/7298/files)] - [stack/pipelines-test-a4-run-control](databricks#7426) [[Files changed](https://github.com/databricks/cli/pull/7426/files)] - [stack/pipelines-test-pr3-junit](databricks#7299) [[Files changed](https://github.com/databricks/cli/pull/7299/files)] - [stack/pipelines-test-junit-flag](databricks#7434) [[Files changed](https://github.com/databricks/cli/pull/7434/files)] --------- - Read every page of an update's test events with the SDK's `ListPipelineEventsRequest` and `buildPipelineEventFilter`. Existing code is not changed. - Collect one result per test case and check that the results are complete. - Not used by the command yet. - Start test-only updates with `w.Pipelines.StartUpdate`: the Go SDK now has `test_only` and `test_options`. The body has the same fields and values; only the key order inside `test_options` follows the SDK type (one golden file). - The List Pipeline Events request stays a direct call: the SDK's `PipelineEvent` has no `details` or `origin.test_case_id`, which the test results come from. - The short help says *Experimental*, like the long help and the gate. A selection outside the synced files, and a relative selection with `workspace.sync_mode: immutable`, now say which /Workspace path to pass. Tests: unit tests, including 200 cases over 3 pages; acceptance `pipelines/test/*`. This pull request and its description were written by Isaac. --------- Co-authored-by: Isaac <no-reply@databricks.com>
idelafuente-oc
pushed a commit
to idelafuente-oc/cli
that referenced
this pull request
Nov 20, 2026
## 🥞 Stacked PR - [stack/pipelines-test-pr1-command](databricks#7297) [[Files changed](https://github.com/databricks/cli/pull/7297/files)] - [stack/pipelines-test-bundle-key](databricks#7431) [[Files changed](https://github.com/databricks/cli/pull/7431/files)] - [stack/pipelines-test-read-events](databricks#7432) [[Files changed](https://github.com/databricks/cli/pull/7432/files)] - [**stack/pipelines-test-print-results**](databricks#7433) [[Files changed](https://github.com/databricks/cli/pull/7433/files)] ← _this PR_ - [stack/pipelines-test-pr2-output](databricks#7298) [[Files changed](https://github.com/databricks/cli/pull/7298/files)] - [stack/pipelines-test-a4-run-control](databricks#7426) [[Files changed](https://github.com/databricks/cli/pull/7426/files)] - [stack/pipelines-test-pr3-junit](databricks#7299) [[Files changed](https://github.com/databricks/cli/pull/7299/files)] - [stack/pipelines-test-junit-flag](databricks#7434) [[Files changed](https://github.com/databricks/cli/pull/7434/files)] --------- - Print test results: `<i> of <n> <STATUS> <test ID> ....... [<STATUS> in <s>s]`, failure details, and a last line `Done. PASSED=… TOTAL=…`. - Not used by the command yet. Tests: unit tests. This pull request and its description were written by Isaac. Co-authored-by: Isaac <no-reply@databricks.com>
idelafuente-oc
pushed a commit
to idelafuente-oc/cli
that referenced
this pull request
Nov 20, 2026
…ks#7298) ## 🥞 Stacked PR - [stack/pipelines-test-pr1-command](databricks#7297) [[Files changed](https://github.com/databricks/cli/pull/7297/files)] - [stack/pipelines-test-bundle-key](databricks#7431) [[Files changed](https://github.com/databricks/cli/pull/7431/files)] - [stack/pipelines-test-read-events](databricks#7432) [[Files changed](https://github.com/databricks/cli/pull/7432/files)] - [stack/pipelines-test-print-results](databricks#7433) [[Files changed](https://github.com/databricks/cli/pull/7433/files)] - [**stack/pipelines-test-pr2-output**](databricks#7298) [[Files changed](https://github.com/databricks/cli/pull/7298/files)] ← _this PR_ - [stack/pipelines-test-a4-run-control](databricks#7426) [[Files changed](https://github.com/databricks/cli/pull/7426/files)] - [stack/pipelines-test-pr3-junit](databricks#7299) [[Files changed](https://github.com/databricks/cli/pull/7299/files)] - [stack/pipelines-test-junit-flag](databricks#7434) [[Files changed](https://github.com/databricks/cli/pull/7434/files)] --------- - Wait for the test update, print the results, and exit 0 only when at least one test ran and none failed or errored. - `--no-wait` returns after the update starts. - The wait follows the bundle pipeline runner's loop. - "No tests were collected" names the selection, or the pipeline's test sources, and points to the `--pytest-arg` filters when they were given. - The changelog entry for the results output is in this PR. Tests: unit tests; acceptance in `acceptance/pipelines/test/results/*`, with the service stubbed per case. This pull request and its description were written by Isaac. --------- Co-authored-by: Isaac <no-reply@databricks.com>
idelafuente-oc
pushed a commit
to idelafuente-oc/cli
that referenced
this pull request
Nov 20, 2026
) ## 🥞 Stacked PR - [stack/pipelines-test-pr1-command](databricks#7297) [[Files changed](https://github.com/databricks/cli/pull/7297/files)] - [stack/pipelines-test-bundle-key](databricks#7431) [[Files changed](https://github.com/databricks/cli/pull/7431/files)] - [stack/pipelines-test-read-events](databricks#7432) [[Files changed](https://github.com/databricks/cli/pull/7432/files)] - [stack/pipelines-test-print-results](databricks#7433) [[Files changed](https://github.com/databricks/cli/pull/7433/files)] - [stack/pipelines-test-pr2-output](databricks#7298) [[Files changed](https://github.com/databricks/cli/pull/7298/files)] - [**stack/pipelines-test-a4-run-control**](databricks#7426) [[Files changed](https://github.com/databricks/cli/pull/7426/files)] ← _this PR_ - [stack/pipelines-test-pr3-junit](databricks#7299) [[Files changed](https://github.com/databricks/cli/pull/7299/files)] - [stack/pipelines-test-junit-flag](databricks#7434) [[Files changed](https://github.com/databricks/cli/pull/7434/files)] --------- - `--timeout` and Ctrl+C stop the local wait and print the `--resume` command; the update keeps running. - `--resume <update-id>` reads an existing test update. - A Ctrl+C during Start Update still prints the update ID; a second Ctrl+C ends the process. - `--resume` reads `test_only` with `w.Pipelines.GetUpdate`: the Go SDK now has `UpdateInfo.test_only`. As before, only an explicit `test_only: false` is rejected; an update without the field is accepted. - A failed read of the update or its events ends with the `--resume` command, as a timeout does. An incomplete result prints the `--resume` command before the summary. - When Start Update says an update is already active, the error says to wait, to stop it (bundle pipelines), or to read it with `--resume`. - The changelog entry for `--resume` and `--timeout` is in this PR. Tests: unit tests; acceptance in `acceptance/pipelines/test/run-control/*`. This pull request and its description were written by Isaac. --------- Co-authored-by: Isaac <no-reply@databricks.com>
idelafuente-oc
pushed a commit
to idelafuente-oc/cli
that referenced
this pull request
Nov 20, 2026
) ## 🥞 Stacked PR - [stack/pipelines-test-pr1-command](databricks#7297) [[Files changed](https://github.com/databricks/cli/pull/7297/files)] - [stack/pipelines-test-bundle-key](databricks#7431) [[Files changed](https://github.com/databricks/cli/pull/7431/files)] - [stack/pipelines-test-read-events](databricks#7432) [[Files changed](https://github.com/databricks/cli/pull/7432/files)] - [stack/pipelines-test-print-results](databricks#7433) [[Files changed](https://github.com/databricks/cli/pull/7433/files)] - [stack/pipelines-test-pr2-output](databricks#7298) [[Files changed](https://github.com/databricks/cli/pull/7298/files)] - [stack/pipelines-test-a4-run-control](databricks#7426) [[Files changed](https://github.com/databricks/cli/pull/7426/files)] - [**stack/pipelines-test-pr3-junit**](databricks#7299) [[Files changed](https://github.com/databricks/cli/pull/7299/files)] ← _this PR_ - [stack/pipelines-test-junit-flag](databricks#7434) [[Files changed](https://github.com/databricks/cli/pull/7434/files)] --------- - Build a JUnit XML report from a test run: one entry per case, plus a failing entry for an incomplete run. - The file is replaced atomically. - Not used by the command yet. - Every failing entry that the command adds is named `pipelines test`; the update ID is in the entry's text. Tests: unit tests. This pull request and its description were written by Isaac. --------- Co-authored-by: Isaac <no-reply@databricks.com>
idelafuente-oc
pushed a commit
to idelafuente-oc/cli
that referenced
this pull request
Nov 20, 2026
) ## 🥞 Stacked PR - [stack/pipelines-test-pr1-command](databricks#7297) [[Files changed](https://github.com/databricks/cli/pull/7297/files)] - [stack/pipelines-test-bundle-key](databricks#7431) [[Files changed](https://github.com/databricks/cli/pull/7431/files)] - [stack/pipelines-test-read-events](databricks#7432) [[Files changed](https://github.com/databricks/cli/pull/7432/files)] - [stack/pipelines-test-print-results](databricks#7433) [[Files changed](https://github.com/databricks/cli/pull/7433/files)] - [stack/pipelines-test-pr2-output](databricks#7298) [[Files changed](https://github.com/databricks/cli/pull/7298/files)] - [stack/pipelines-test-a4-run-control](databricks#7426) [[Files changed](https://github.com/databricks/cli/pull/7426/files)] - [stack/pipelines-test-pr3-junit](databricks#7299) [[Files changed](https://github.com/databricks/cli/pull/7299/files)] - [**stack/pipelines-test-junit-flag**](databricks#7434) [[Files changed](https://github.com/databricks/cli/pull/7434/files)] ← _this PR_ --------- - Add `--junit-xml <path>`, which writes the report on every exit after the flags parse. - The `JUnit report:` line prints before the summary line. - The help has examples: all tests, one file, one test by ID, CI with `--junit-xml`, `--timeout` then `--resume`, and `--pipeline-id`. - The changelog entry for `--junit-xml` is in this PR. Tests: acceptance reports (`out.*.xml`) in `acceptance/pipelines/test/*`. This pull request and its description were written by Isaac. --------- Co-authored-by: Isaac <no-reply@databricks.com>
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
🥞 Stacked PR
pipelines test [flags] [KEY] [TEST_SELECTION...].Tests: unit tests; acceptance in
acceptance/pipelines/test/{selection,immutable}.This pull request and its description were written by Isaac.