Repository navigation
Write a JUnit XML report from databricks pipelines test - #7434
Merged
Merged
Conversation
This was referenced Nov 10, 2026
Contributor
|
Commit: Regression test reportSelected 8 changed tests (limit=20, 0 not selected) 8 tests: regression=8 unreleased=0 coverage=0 failing=0
TestAccept/pipelines/test/arguments: branch ✅ | main (a6da538) ❌ | latest (v1.26.0) ❌main (a6da538): latest (v1.26.0): TestAccept/pipelines/test/invalid-project: branch ✅ | main (a6da538) ❌ | latest (v1.26.0) ❌main (a6da538): latest (v1.26.0): TestAccept/pipelines/test/results/failed: branch ✅ | main (a6da538) ❌ | latest (v1.26.0) ❌main (a6da538): latest (v1.26.0): TestAccept/pipelines/test/results/incomplete: branch ✅ | main (a6da538) ❌ | latest (v1.26.0) ❌main (a6da538): latest (v1.26.0): TestAccept/pipelines/test/results/passed: branch ✅ | main (a6da538) ❌ | latest (v1.26.0) ❌main (a6da538): latest (v1.26.0): TestAccept/pipelines/test/run-control/canceled: branch ✅ | main (a6da538) ❌ | latest (v1.26.0) ❌main (a6da538): latest (v1.26.0): 2 more failure details omitted, see the full report in the run. |
tharunbhuk-db
force-pushed
the
tharun/pipelines-test-junit-flag
branch
from
November 10, 2026 07:11
98b0082 to
c9c5f8c
Compare
tharunbhuk-db
force-pushed
the
tharun/pipelines-test-pr3-junit
branch
from
November 10, 2026 07:11
58df287 to
9d83e17
Compare
tharunbhuk-db
force-pushed
the
tharun/pipelines-test-junit-flag
branch
from
November 10, 2026 09:08
c9c5f8c to
e358a5d
Compare
tharunbhuk-db
force-pushed
the
tharun/pipelines-test-pr3-junit
branch
from
November 10, 2026 09:08
9d83e17 to
062047b
Compare
tharunbhuk-db
marked this pull request as ready for review
November 10, 2026 09:21
tharunbhuk-db
requested review from
anton-107
and removed request for
a team and
anton-107
November 10, 2026 09:21
tharunbhuk-db
added a commit
that referenced
this pull request
Nov 10, 2026
Co-authored-by: Isaac <no-reply@databricks.com>
tharunbhuk-db
added a commit
that referenced
this pull request
Nov 10, 2026
Co-authored-by: Isaac <no-reply@databricks.com>
tharunbhuk-db
added a commit
that referenced
this pull request
Nov 10, 2026
Co-authored-by: Isaac <no-reply@databricks.com>
tharunbhuk-db
force-pushed
the
tharun/pipelines-test-pr3-junit
branch
from
November 10, 2026 17:14
062047b to
c7628c9
Compare
tharunbhuk-db
force-pushed
the
tharun/pipelines-test-junit-flag
branch
from
November 10, 2026 17:14
e358a5d to
8b690b3
Compare
tharunbhuk-db
added a commit
that referenced
this pull request
Nov 10, 2026
Co-authored-by: Isaac <no-reply@databricks.com>
tharunbhuk-db
added a commit
that referenced
this pull request
Nov 10, 2026
Co-authored-by: Isaac <no-reply@databricks.com>
pranshupand-db
approved these changes
Nov 10, 2026
tharunbhuk-db
added a commit
that referenced
this pull request
Nov 11, 2026
Co-authored-by: Isaac <no-reply@databricks.com>
tharunbhuk-db
force-pushed
the
tharun/pipelines-test-pr3-junit
branch
from
November 16, 2026 22:19
c7628c9 to
0302118
Compare
tharunbhuk-db
force-pushed
the
tharun/pipelines-test-junit-flag
branch
from
November 16, 2026 22:20
8b690b3 to
29d2e9c
Compare
tharunbhuk-db
force-pushed
the
tharun/pipelines-test-pr3-junit
branch
from
November 17, 2026 00:18
0302118 to
b7f7b0a
Compare
tharunbhuk-db
force-pushed
the
tharun/pipelines-test-junit-flag
branch
from
November 17, 2026 00:18
29d2e9c to
cbb83bc
Compare
tharunbhuk-db
added a commit
that referenced
this pull request
Nov 17, 2026
Co-authored-by: Isaac <no-reply@databricks.com>
tharunbhuk-db
added a commit
that referenced
this pull request
Nov 17, 2026
tharunbhuk-db
force-pushed
the
tharun/pipelines-test-pr3-junit
branch
from
November 17, 2026 07:01
b7f7b0a to
04bb909
Compare
tharunbhuk-db
force-pushed
the
tharun/pipelines-test-junit-flag
branch
from
November 17, 2026 07:01
cbb83bc to
40e2046
Compare
tharunbhuk-db
force-pushed
the
tharun/pipelines-test-pr3-junit
branch
from
November 17, 2026 08:19
04bb909 to
2eec88e
Compare
tharunbhuk-db
force-pushed
the
tharun/pipelines-test-junit-flag
branch
from
November 17, 2026 08:19
40e2046 to
bc59e20
Compare
tharunbhuk-db
force-pushed
the
tharun/pipelines-test-pr3-junit
branch
from
November 17, 2026 09:12
2eec88e to
7a5f44f
Compare
--junit-xml writes one testcase per collected test case, with its outcome and duration; an incomplete run, a run without tests, or a timeout adds a failing entry that names the cause. The report replaces the file on every exit after the flags parse, including the disabled-command error and project errors, so an older report never survives; a flag that cannot be parsed ends the command before it runs. --junit-xml cannot be combined with the no-wait flag, and the printed resume command keeps --junit-xml so that it replaces a partial report. The report line prints before the summary, so the summary stays the last line. Co-authored-by: Isaac <no-reply@databricks.com>
The help shows the common flows: all tests, one file, one test by ID, CI with --junit-xml, --timeout then --resume, and --pipeline-id. The entry for an error before the update starts uses the same name as the other entries that the command adds. The changelog entry for --junit-xml moves to this PR. Co-authored-by: Isaac <no-reply@databricks.com>
The entry is added with the other pipeline testing entries in #7439. Co-authored-by: Isaac <no-reply@databricks.com>
tharunbhuk-db
force-pushed
the
tharun/pipelines-test-junit-flag
branch
from
November 17, 2026 09:35
bc59e20 to
ef045d0
Compare
idelafuente-oc
pushed a commit
to idelafuente-oc/cli
that referenced
this pull request
Nov 20, 2026
## 🥞 Stacked PR - [stack/pipelines-test-pr1-command](databricks#7297) [[Files changed](https://github.com/databricks/cli/pull/7297/files)] - [stack/pipelines-test-bundle-key](databricks#7431) [[Files changed](https://github.com/databricks/cli/pull/7431/files)] - [**stack/pipelines-test-read-events**](databricks#7432) [[Files changed](https://github.com/databricks/cli/pull/7432/files)] ← _this PR_ - [stack/pipelines-test-print-results](databricks#7433) [[Files changed](https://github.com/databricks/cli/pull/7433/files)] - [stack/pipelines-test-pr2-output](databricks#7298) [[Files changed](https://github.com/databricks/cli/pull/7298/files)] - [stack/pipelines-test-a4-run-control](databricks#7426) [[Files changed](https://github.com/databricks/cli/pull/7426/files)] - [stack/pipelines-test-pr3-junit](databricks#7299) [[Files changed](https://github.com/databricks/cli/pull/7299/files)] - [stack/pipelines-test-junit-flag](databricks#7434) [[Files changed](https://github.com/databricks/cli/pull/7434/files)] --------- - Read every page of an update's test events with the SDK's `ListPipelineEventsRequest` and `buildPipelineEventFilter`. Existing code is not changed. - Collect one result per test case and check that the results are complete. - Not used by the command yet. - Start test-only updates with `w.Pipelines.StartUpdate`: the Go SDK now has `test_only` and `test_options`. The body has the same fields and values; only the key order inside `test_options` follows the SDK type (one golden file). - The List Pipeline Events request stays a direct call: the SDK's `PipelineEvent` has no `details` or `origin.test_case_id`, which the test results come from. - The short help says *Experimental*, like the long help and the gate. A selection outside the synced files, and a relative selection with `workspace.sync_mode: immutable`, now say which /Workspace path to pass. Tests: unit tests, including 200 cases over 3 pages; acceptance `pipelines/test/*`. This pull request and its description were written by Isaac. --------- Co-authored-by: Isaac <no-reply@databricks.com>
idelafuente-oc
pushed a commit
to idelafuente-oc/cli
that referenced
this pull request
Nov 20, 2026
## 🥞 Stacked PR - [stack/pipelines-test-pr1-command](databricks#7297) [[Files changed](https://github.com/databricks/cli/pull/7297/files)] - [stack/pipelines-test-bundle-key](databricks#7431) [[Files changed](https://github.com/databricks/cli/pull/7431/files)] - [stack/pipelines-test-read-events](databricks#7432) [[Files changed](https://github.com/databricks/cli/pull/7432/files)] - [**stack/pipelines-test-print-results**](databricks#7433) [[Files changed](https://github.com/databricks/cli/pull/7433/files)] ← _this PR_ - [stack/pipelines-test-pr2-output](databricks#7298) [[Files changed](https://github.com/databricks/cli/pull/7298/files)] - [stack/pipelines-test-a4-run-control](databricks#7426) [[Files changed](https://github.com/databricks/cli/pull/7426/files)] - [stack/pipelines-test-pr3-junit](databricks#7299) [[Files changed](https://github.com/databricks/cli/pull/7299/files)] - [stack/pipelines-test-junit-flag](databricks#7434) [[Files changed](https://github.com/databricks/cli/pull/7434/files)] --------- - Print test results: `<i> of <n> <STATUS> <test ID> ....... [<STATUS> in <s>s]`, failure details, and a last line `Done. PASSED=… TOTAL=…`. - Not used by the command yet. Tests: unit tests. This pull request and its description were written by Isaac. Co-authored-by: Isaac <no-reply@databricks.com>
idelafuente-oc
pushed a commit
to idelafuente-oc/cli
that referenced
this pull request
Nov 20, 2026
…ks#7298) ## 🥞 Stacked PR - [stack/pipelines-test-pr1-command](databricks#7297) [[Files changed](https://github.com/databricks/cli/pull/7297/files)] - [stack/pipelines-test-bundle-key](databricks#7431) [[Files changed](https://github.com/databricks/cli/pull/7431/files)] - [stack/pipelines-test-read-events](databricks#7432) [[Files changed](https://github.com/databricks/cli/pull/7432/files)] - [stack/pipelines-test-print-results](databricks#7433) [[Files changed](https://github.com/databricks/cli/pull/7433/files)] - [**stack/pipelines-test-pr2-output**](databricks#7298) [[Files changed](https://github.com/databricks/cli/pull/7298/files)] ← _this PR_ - [stack/pipelines-test-a4-run-control](databricks#7426) [[Files changed](https://github.com/databricks/cli/pull/7426/files)] - [stack/pipelines-test-pr3-junit](databricks#7299) [[Files changed](https://github.com/databricks/cli/pull/7299/files)] - [stack/pipelines-test-junit-flag](databricks#7434) [[Files changed](https://github.com/databricks/cli/pull/7434/files)] --------- - Wait for the test update, print the results, and exit 0 only when at least one test ran and none failed or errored. - `--no-wait` returns after the update starts. - The wait follows the bundle pipeline runner's loop. - "No tests were collected" names the selection, or the pipeline's test sources, and points to the `--pytest-arg` filters when they were given. - The changelog entry for the results output is in this PR. Tests: unit tests; acceptance in `acceptance/pipelines/test/results/*`, with the service stubbed per case. This pull request and its description were written by Isaac. --------- Co-authored-by: Isaac <no-reply@databricks.com>
idelafuente-oc
pushed a commit
to idelafuente-oc/cli
that referenced
this pull request
Nov 20, 2026
) ## 🥞 Stacked PR - [stack/pipelines-test-pr1-command](databricks#7297) [[Files changed](https://github.com/databricks/cli/pull/7297/files)] - [stack/pipelines-test-bundle-key](databricks#7431) [[Files changed](https://github.com/databricks/cli/pull/7431/files)] - [stack/pipelines-test-read-events](databricks#7432) [[Files changed](https://github.com/databricks/cli/pull/7432/files)] - [stack/pipelines-test-print-results](databricks#7433) [[Files changed](https://github.com/databricks/cli/pull/7433/files)] - [stack/pipelines-test-pr2-output](databricks#7298) [[Files changed](https://github.com/databricks/cli/pull/7298/files)] - [**stack/pipelines-test-a4-run-control**](databricks#7426) [[Files changed](https://github.com/databricks/cli/pull/7426/files)] ← _this PR_ - [stack/pipelines-test-pr3-junit](databricks#7299) [[Files changed](https://github.com/databricks/cli/pull/7299/files)] - [stack/pipelines-test-junit-flag](databricks#7434) [[Files changed](https://github.com/databricks/cli/pull/7434/files)] --------- - `--timeout` and Ctrl+C stop the local wait and print the `--resume` command; the update keeps running. - `--resume <update-id>` reads an existing test update. - A Ctrl+C during Start Update still prints the update ID; a second Ctrl+C ends the process. - `--resume` reads `test_only` with `w.Pipelines.GetUpdate`: the Go SDK now has `UpdateInfo.test_only`. As before, only an explicit `test_only: false` is rejected; an update without the field is accepted. - A failed read of the update or its events ends with the `--resume` command, as a timeout does. An incomplete result prints the `--resume` command before the summary. - When Start Update says an update is already active, the error says to wait, to stop it (bundle pipelines), or to read it with `--resume`. - The changelog entry for `--resume` and `--timeout` is in this PR. Tests: unit tests; acceptance in `acceptance/pipelines/test/run-control/*`. This pull request and its description were written by Isaac. --------- Co-authored-by: Isaac <no-reply@databricks.com>
idelafuente-oc
pushed a commit
to idelafuente-oc/cli
that referenced
this pull request
Nov 20, 2026
) ## 🥞 Stacked PR - [stack/pipelines-test-pr1-command](databricks#7297) [[Files changed](https://github.com/databricks/cli/pull/7297/files)] - [stack/pipelines-test-bundle-key](databricks#7431) [[Files changed](https://github.com/databricks/cli/pull/7431/files)] - [stack/pipelines-test-read-events](databricks#7432) [[Files changed](https://github.com/databricks/cli/pull/7432/files)] - [stack/pipelines-test-print-results](databricks#7433) [[Files changed](https://github.com/databricks/cli/pull/7433/files)] - [stack/pipelines-test-pr2-output](databricks#7298) [[Files changed](https://github.com/databricks/cli/pull/7298/files)] - [stack/pipelines-test-a4-run-control](databricks#7426) [[Files changed](https://github.com/databricks/cli/pull/7426/files)] - [**stack/pipelines-test-pr3-junit**](databricks#7299) [[Files changed](https://github.com/databricks/cli/pull/7299/files)] ← _this PR_ - [stack/pipelines-test-junit-flag](databricks#7434) [[Files changed](https://github.com/databricks/cli/pull/7434/files)] --------- - Build a JUnit XML report from a test run: one entry per case, plus a failing entry for an incomplete run. - The file is replaced atomically. - Not used by the command yet. - Every failing entry that the command adds is named `pipelines test`; the update ID is in the entry's text. Tests: unit tests. This pull request and its description were written by Isaac. --------- Co-authored-by: Isaac <no-reply@databricks.com>
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
🥞 Stacked PR
--junit-xml <path>, which writes the report on every exit after the flags parse.JUnit report:line prints before the summary line.--junit-xml,--timeoutthen--resume, and--pipeline-id.--junit-xmlis in this PR.Tests: acceptance reports (
out.*.xml) inacceptance/pipelines/test/*.This pull request and its description were written by Isaac.