Repository navigation
Add --resume and --timeout to databricks pipelines test - #7426
Merged
Merged
Conversation
tharunbhuk-db
force-pushed
the
tharun/pipelines-test-pr2-output
branch
from
November 10, 2026 00:25
23e0bb0 to
b45969f
Compare
tharunbhuk-db
force-pushed
the
tharun/pipelines-test-a4-run-control
branch
from
November 10, 2026 00:25
cd64420 to
17f12d7
Compare
This was referenced Nov 10, 2026
Contributor
|
Commit: Regression test reportSelected 7 changed tests (limit=20, 0 not selected) 7 tests: regression=7 unreleased=0 coverage=0 failing=0
TestAccept/pipelines/test/arguments: branch ✅ | main (4e503ea) ❌ | latest (v1.26.0) ❌main (4e503ea): latest (v1.26.0): TestAccept/pipelines/test/results/incomplete: branch ✅ | main (4e503ea) ❌ | latest (v1.26.0) ❌main (4e503ea): latest (v1.26.0): TestAccept/pipelines/test/run-control/canceled: branch ✅ | main (4e503ea) ❌ | latest (v1.26.0) ❌main (4e503ea): latest (v1.26.0): TestAccept/pipelines/test/run-control/not-test-update: branch ✅ | main (4e503ea) ❌ | latest (v1.26.0) ❌main (4e503ea): latest (v1.26.0): TestAccept/pipelines/test/run-control/resume: branch ✅ | main (4e503ea) ❌ | latest (v1.26.0) ❌main (4e503ea): latest (v1.26.0): TestAccept/pipelines/test/run-control/timeout: branch ✅ | main (4e503ea) ❌ | latest (v1.26.0) ❌main (4e503ea): latest (v1.26.0): TestAccept/pipelines/test/submit-error: branch ✅ | main (4e503ea) ❌ | latest (v1.26.0) ❌main (4e503ea): latest (v1.26.0): same output as main (4e503ea) |
Collaborator
✅ Integration test reportCommit: 17f12d7
Top 3 slowest tests (at least 2 minutes):
|
tharunbhuk-db
added a commit
that referenced
this pull request
Nov 10, 2026
tharunbhuk-db
force-pushed
the
tharun/pipelines-test-pr2-output
branch
from
November 10, 2026 04:14
b45969f to
e8a772a
Compare
tharunbhuk-db
force-pushed
the
tharun/pipelines-test-a4-run-control
branch
from
November 10, 2026 04:14
17f12d7 to
2f8b6d9
Compare
This was referenced Nov 10, 2026
tharunbhuk-db
force-pushed
the
tharun/pipelines-test-pr2-output
branch
from
November 10, 2026 06:26
e8a772a to
e7de143
Compare
tharunbhuk-db
force-pushed
the
tharun/pipelines-test-a4-run-control
branch
from
November 10, 2026 06:57
2f8b6d9 to
e225070
Compare
tharunbhuk-db
marked this pull request as ready for review
November 10, 2026 07:08
tharunbhuk-db
requested review from
pranshupand-db and
renaudhartert-db
and removed request for
a team and
renaudhartert-db
November 10, 2026 07:08
tharunbhuk-db
force-pushed
the
tharun/pipelines-test-a4-run-control
branch
from
November 10, 2026 09:08
e225070 to
1059c51
Compare
tharunbhuk-db
force-pushed
the
tharun/pipelines-test-a4-run-control
branch
from
November 10, 2026 17:14
1059c51 to
66654a5
Compare
pranshupand-db
approved these changes
Nov 10, 2026
idelafuente-oc
pushed a commit
to idelafuente-oc/cli
that referenced
this pull request
Nov 11, 2026
## 🥞 Stacked PR Use this [link](https://github.com/databricks/cli/pull/7297/files) to review incremental changes. - [**stack/pipelines-test-pr1-command**](databricks#7297) [[Files changed](https://github.com/databricks/cli/pull/7297/files)] ← _this PR_ - [stack/pipelines-test-bundle-key](databricks#7431) [[Files changed](https://github.com/databricks/cli/pull/7431/files)] - [stack/pipelines-test-read-events](databricks#7432) [[Files changed](https://github.com/databricks/cli/pull/7432/files)] - [stack/pipelines-test-print-results](databricks#7433) [[Files changed](https://github.com/databricks/cli/pull/7433/files)] - [stack/pipelines-test-pr2-output](databricks#7298) [[Files changed](https://github.com/databricks/cli/pull/7298/files)] - [stack/pipelines-test-a4-run-control](databricks#7426) [[Files changed](https://github.com/databricks/cli/pull/7426/files)] - [stack/pipelines-test-pr3-junit](databricks#7299) [[Files changed](https://github.com/databricks/cli/pull/7299/files)] - [stack/pipelines-test-junit-flag](databricks#7434) [[Files changed](https://github.com/databricks/cli/pull/7434/files)] --------- - Add `databricks pipelines test --pipeline-id <id> [TEST_SELECTION...]`: starts a test-only update and prints its IDs. - Experimental: runs only with `DATABRICKS_CLI_PIPELINES_TEST=true`. - Selections are workspace paths or paths relative to `root_path`, sent as typed. `--pytest-arg` accepts only `-k` and `-m`. Tests: unit tests; acceptance in `acceptance/pipelines/test/{arguments,pipeline-id,submit-error}`. This pull request and its description were written by Isaac. Co-authored-by: Isaac <no-reply@databricks.com>
idelafuente-oc
pushed a commit
to idelafuente-oc/cli
that referenced
this pull request
Nov 11, 2026
## 🥞 Stacked PR - [stack/pipelines-test-pr1-command](databricks#7297) [[Files changed](https://github.com/databricks/cli/pull/7297/files)] - [**stack/pipelines-test-bundle-key**](databricks#7431) [[Files changed](https://github.com/databricks/cli/pull/7431/files)] ← _this PR_ - [stack/pipelines-test-read-events](databricks#7432) [[Files changed](https://github.com/databricks/cli/pull/7432/files)] - [stack/pipelines-test-print-results](databricks#7433) [[Files changed](https://github.com/databricks/cli/pull/7433/files)] - [stack/pipelines-test-pr2-output](databricks#7298) [[Files changed](https://github.com/databricks/cli/pull/7298/files)] - [stack/pipelines-test-a4-run-control](databricks#7426) [[Files changed](https://github.com/databricks/cli/pull/7426/files)] - [stack/pipelines-test-pr3-junit](databricks#7299) [[Files changed](https://github.com/databricks/cli/pull/7299/files)] - [stack/pipelines-test-junit-flag](databricks#7434) [[Files changed](https://github.com/databricks/cli/pull/7434/files)] --------- - In a bundle, identify the pipeline by KEY: `pipelines test [flags] [KEY] [TEST_SELECTION...]`. - Relative selections are local paths, mapped to their deployed paths. - A first argument that is not a KEY gets an error that names the bundle's pipelines and the working command. Tests: unit tests; acceptance in `acceptance/pipelines/test/{selection,immutable}`. This pull request and its description were written by Isaac. Co-authored-by: Isaac <no-reply@databricks.com>
tharunbhuk-db
force-pushed
the
tharun/pipelines-test-pr2-output
branch
from
November 16, 2026 22:19
d0d7138 to
cdc73e0
Compare
tharunbhuk-db
force-pushed
the
tharun/pipelines-test-a4-run-control
branch
from
November 16, 2026 22:19
66654a5 to
37575dd
Compare
tharunbhuk-db
force-pushed
the
tharun/pipelines-test-pr2-output
branch
from
November 17, 2026 00:17
cdc73e0 to
86122f3
Compare
tharunbhuk-db
force-pushed
the
tharun/pipelines-test-a4-run-control
branch
from
November 17, 2026 00:17
37575dd to
3b224ed
Compare
tharunbhuk-db
added a commit
that referenced
this pull request
Nov 17, 2026
tharunbhuk-db
force-pushed
the
tharun/pipelines-test-pr2-output
branch
from
November 17, 2026 07:00
86122f3 to
ae6fcdc
Compare
tharunbhuk-db
force-pushed
the
tharun/pipelines-test-a4-run-control
branch
from
November 17, 2026 07:01
3b224ed to
4a3c384
Compare
tharunbhuk-db
force-pushed
the
tharun/pipelines-test-pr2-output
branch
from
November 17, 2026 07:56
ae6fcdc to
cfe688b
Compare
tharunbhuk-db
force-pushed
the
tharun/pipelines-test-a4-run-control
branch
from
November 17, 2026 08:19
4a3c384 to
3554c4f
Compare
--timeout and Ctrl+C end only the local wait and print the command that reads the results later; the update keeps running. That command keeps the KEY or --pipeline-id, --target, --profile and every --var. --resume <update-id> reads the results of an existing test update instead of starting one, and rejects an update that the service reports is not a test update. The signal handler is installed before the update starts, but only the wait listens to it, so a Ctrl+C during Start Update still prints the update ID. The first signal releases the handler, so a second one ends the process. Co-authored-by: Isaac <no-reply@databricks.com>
The Go SDK now has UpdateInfo.test_only, so --resume checks the update with w.Pipelines.GetUpdate instead of sending the request directly. As before, it rejects the update only when the response has test_only set to false; an update without the field is accepted. Co-authored-by: Isaac <no-reply@databricks.com>
…ing a run When the update or its events cannot be read, the error ends with the --resume command, as on a timeout. An incomplete result prints the --resume command before the summary, because events can arrive after the update ends. When Start Update says the pipeline already has an active update, the error says to wait, to stop it (for a bundle pipeline), or to read it with --resume. The changelog entry for --resume and --timeout moves to this PR. Co-authored-by: Isaac <no-reply@databricks.com>
The timeout was checked only between polls, so a slow GetUpdate, event read or SDK retry could finish after it and report the update as completed. All reads now use a context that the timeout cancels. It is a cancel, not a deadline, because the SDK rate limiter fails early on a deadline with an error that does not name the timeout. The timeout error, resume hint and exit code are unchanged. Co-authored-by: Isaac <no-reply@databricks.com>
The entry is added with the other pipeline testing entries in #7439. Co-authored-by: Isaac <no-reply@databricks.com>
tharunbhuk-db
force-pushed
the
tharun/pipelines-test-a4-run-control
branch
from
November 17, 2026 08:47
3554c4f to
69a059e
Compare
Collaborator
❌ Integration test reportCommit: 95d08a4
169 interesting tests: 111 FAIL, 45 MISS, 8 RECOVERED, 5 KNOWN
Top 50 slowest tests (at least 2 minutes):
|
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
🥞 Stacked PR
--timeoutand Ctrl+C stop the local wait and print the--resumecommand; the update keeps running.--resume <update-id>reads an existing test update.--resumereadstest_onlywithw.Pipelines.GetUpdate: the Go SDK now hasUpdateInfo.test_only. As before, only an explicittest_only: falseis rejected; an update without the field is accepted.--resumecommand, as a timeout does. An incomplete result prints the--resumecommand before the summary.--resume.--resumeand--timeoutis in this PR.Tests: unit tests; acceptance in
acceptance/pipelines/test/run-control/*.This pull request and its description were written by Isaac.