From 3ca55f42ddd2d9a988bd851883a6e6ecef82be4b Mon Sep 17 00:00:00 2001 From: Bhukya Date: Tue, 10 Nov 2026 10:07:43 +0000 Subject: [PATCH 1/6] Add the changelog entries for pipeline testing One fragment per user-visible behavior of the pipelines test command and the testing property of pipelines. Each links the PRs that add the behavior and this PR. Co-authored-by: Isaac --- .nextchanges/bundles/pipelines-testing-plan.md | 1 + .nextchanges/bundles/pipelines-testing.md | 1 + .nextchanges/cli/pipelines-test-junit.md | 1 + .nextchanges/cli/pipelines-test-results.md | 1 + .nextchanges/cli/pipelines-test-run-control.md | 1 + .nextchanges/cli/pipelines-test.md | 1 + 6 files changed, 6 insertions(+) create mode 100644 .nextchanges/bundles/pipelines-testing-plan.md create mode 100644 .nextchanges/bundles/pipelines-testing.md create mode 100644 .nextchanges/cli/pipelines-test-junit.md create mode 100644 .nextchanges/cli/pipelines-test-results.md create mode 100644 .nextchanges/cli/pipelines-test-run-control.md create mode 100644 .nextchanges/cli/pipelines-test.md diff --git a/.nextchanges/bundles/pipelines-testing-plan.md b/.nextchanges/bundles/pipelines-testing-plan.md new file mode 100644 index 00000000000..6d7b664d750 --- /dev/null +++ b/.nextchanges/bundles/pipelines-testing-plan.md @@ -0,0 +1 @@ +* With `DATABRICKS_BUNDLE_ENABLE_EXPERIMENTAL_PIPELINE_TESTING=true`, `bundle plan` shows a change to the `testing` property of a pipeline that was made outside the bundle, and `bundle deploy` undoes it. ([#7438](https://github.com/databricks/cli/pull/7438), [#7439](https://github.com/databricks/cli/pull/7439)) diff --git a/.nextchanges/bundles/pipelines-testing.md b/.nextchanges/bundles/pipelines-testing.md new file mode 100644 index 00000000000..28fce725932 --- /dev/null +++ b/.nextchanges/bundles/pipelines-testing.md @@ -0,0 +1 @@ +* Add the experimental `testing` property of pipelines, with the test sources and test-only dependencies that `databricks pipelines test` runs with. It needs `DATABRICKS_BUNDLE_ENABLE_EXPERIMENTAL_PIPELINE_TESTING=true`. ([#7300](https://github.com/databricks/cli/pull/7300), [#7437](https://github.com/databricks/cli/pull/7437), [#7439](https://github.com/databricks/cli/pull/7439)) diff --git a/.nextchanges/cli/pipelines-test-junit.md b/.nextchanges/cli/pipelines-test-junit.md new file mode 100644 index 00000000000..ce616ad8e01 --- /dev/null +++ b/.nextchanges/cli/pipelines-test-junit.md @@ -0,0 +1 @@ +* Add `--junit-xml` to `databricks pipelines test`, which writes the results of the test run to a JUnit XML report. ([#7299](https://github.com/databricks/cli/pull/7299), [#7434](https://github.com/databricks/cli/pull/7434), [#7439](https://github.com/databricks/cli/pull/7439)) diff --git a/.nextchanges/cli/pipelines-test-results.md b/.nextchanges/cli/pipelines-test-results.md new file mode 100644 index 00000000000..d64ed1c7392 --- /dev/null +++ b/.nextchanges/cli/pipelines-test-results.md @@ -0,0 +1 @@ +* `databricks pipelines test` waits for the test run and prints the result of each test and a summary. `--no-wait` returns after the run starts. ([#7432](https://github.com/databricks/cli/pull/7432), [#7433](https://github.com/databricks/cli/pull/7433), [#7298](https://github.com/databricks/cli/pull/7298), [#7439](https://github.com/databricks/cli/pull/7439)) diff --git a/.nextchanges/cli/pipelines-test-run-control.md b/.nextchanges/cli/pipelines-test-run-control.md new file mode 100644 index 00000000000..be2d30d087b --- /dev/null +++ b/.nextchanges/cli/pipelines-test-run-control.md @@ -0,0 +1 @@ +* Add `--resume` and `--timeout` to `databricks pipelines test`. `--resume` reads the results of an earlier test run without starting a new one. ([#7426](https://github.com/databricks/cli/pull/7426), [#7439](https://github.com/databricks/cli/pull/7439)) diff --git a/.nextchanges/cli/pipelines-test.md b/.nextchanges/cli/pipelines-test.md new file mode 100644 index 00000000000..d0bbcff9630 --- /dev/null +++ b/.nextchanges/cli/pipelines-test.md @@ -0,0 +1 @@ +* Add the experimental `databricks pipelines test` command. It runs the tests of a pipeline in a test-only update, for a bundle pipeline by its KEY or for any pipeline by `--pipeline-id`. It needs `DATABRICKS_CLI_PIPELINES_TEST=true`. ([#7297](https://github.com/databricks/cli/pull/7297), [#7431](https://github.com/databricks/cli/pull/7431), [#7439](https://github.com/databricks/cli/pull/7439)) From 19faf3d237fc015cdf4546410352d78b15849d6f Mon Sep 17 00:00:00 2001 From: Bhukya Date: Mon, 16 Nov 2026 23:56:30 +0000 Subject: [PATCH 2/6] Keep only the changelog entries of merged and stacked PRs The entries for the results output, --resume and --timeout, and --junit-xml move to the PRs that add them, so that the release notes do not name features before they merge. The entry for the testing property says that everyone who deploys the bundle needs this CLI, because a deploy from an older CLI that changes the pipeline removes its testing. Co-authored-by: Isaac --- .nextchanges/bundles/pipelines-testing.md | 2 +- .nextchanges/cli/pipelines-test-junit.md | 1 - .nextchanges/cli/pipelines-test-results.md | 1 - .nextchanges/cli/pipelines-test-run-control.md | 1 - 4 files changed, 1 insertion(+), 4 deletions(-) delete mode 100644 .nextchanges/cli/pipelines-test-junit.md delete mode 100644 .nextchanges/cli/pipelines-test-results.md delete mode 100644 .nextchanges/cli/pipelines-test-run-control.md diff --git a/.nextchanges/bundles/pipelines-testing.md b/.nextchanges/bundles/pipelines-testing.md index 28fce725932..403006ce99e 100644 --- a/.nextchanges/bundles/pipelines-testing.md +++ b/.nextchanges/bundles/pipelines-testing.md @@ -1 +1 @@ -* Add the experimental `testing` property of pipelines, with the test sources and test-only dependencies that `databricks pipelines test` runs with. It needs `DATABRICKS_BUNDLE_ENABLE_EXPERIMENTAL_PIPELINE_TESTING=true`. ([#7300](https://github.com/databricks/cli/pull/7300), [#7437](https://github.com/databricks/cli/pull/7437), [#7439](https://github.com/databricks/cli/pull/7439)) +* Add the experimental `testing` property of pipelines, with the test sources and test-only dependencies that `databricks pipelines test` runs with. It needs `DATABRICKS_BUNDLE_ENABLE_EXPERIMENTAL_PIPELINE_TESTING=true`. Everyone who deploys the bundle needs this CLI version with the variable set: a deploy from an older CLI that changes the pipeline removes its `testing`. ([#7300](https://github.com/databricks/cli/pull/7300), [#7437](https://github.com/databricks/cli/pull/7437), [#7439](https://github.com/databricks/cli/pull/7439)) diff --git a/.nextchanges/cli/pipelines-test-junit.md b/.nextchanges/cli/pipelines-test-junit.md deleted file mode 100644 index ce616ad8e01..00000000000 --- a/.nextchanges/cli/pipelines-test-junit.md +++ /dev/null @@ -1 +0,0 @@ -* Add `--junit-xml` to `databricks pipelines test`, which writes the results of the test run to a JUnit XML report. ([#7299](https://github.com/databricks/cli/pull/7299), [#7434](https://github.com/databricks/cli/pull/7434), [#7439](https://github.com/databricks/cli/pull/7439)) diff --git a/.nextchanges/cli/pipelines-test-results.md b/.nextchanges/cli/pipelines-test-results.md deleted file mode 100644 index d64ed1c7392..00000000000 --- a/.nextchanges/cli/pipelines-test-results.md +++ /dev/null @@ -1 +0,0 @@ -* `databricks pipelines test` waits for the test run and prints the result of each test and a summary. `--no-wait` returns after the run starts. ([#7432](https://github.com/databricks/cli/pull/7432), [#7433](https://github.com/databricks/cli/pull/7433), [#7298](https://github.com/databricks/cli/pull/7298), [#7439](https://github.com/databricks/cli/pull/7439)) diff --git a/.nextchanges/cli/pipelines-test-run-control.md b/.nextchanges/cli/pipelines-test-run-control.md deleted file mode 100644 index be2d30d087b..00000000000 --- a/.nextchanges/cli/pipelines-test-run-control.md +++ /dev/null @@ -1 +0,0 @@ -* Add `--resume` and `--timeout` to `databricks pipelines test`. `--resume` reads the results of an earlier test run without starting a new one. ([#7426](https://github.com/databricks/cli/pull/7426), [#7439](https://github.com/databricks/cli/pull/7439)) From 586a61363f1cb990e593e73f8fa45f2c60f888df Mon Sep 17 00:00:00 2001 From: Bhukya Date: Tue, 17 Nov 2026 08:16:52 +0000 Subject: [PATCH 3/6] Add the changelog entries of the pipelines test results, run control and JUnit PRs They move here from #7298, #7426 and #7434, so that all pipeline testing entries are in one PR. Co-authored-by: Isaac --- .nextchanges/cli/pipelines-test-junit.md | 1 + .nextchanges/cli/pipelines-test-results.md | 1 + .nextchanges/cli/pipelines-test-run-control.md | 1 + 3 files changed, 3 insertions(+) create mode 100644 .nextchanges/cli/pipelines-test-junit.md create mode 100644 .nextchanges/cli/pipelines-test-results.md create mode 100644 .nextchanges/cli/pipelines-test-run-control.md diff --git a/.nextchanges/cli/pipelines-test-junit.md b/.nextchanges/cli/pipelines-test-junit.md new file mode 100644 index 00000000000..85324e7a638 --- /dev/null +++ b/.nextchanges/cli/pipelines-test-junit.md @@ -0,0 +1 @@ +* Add `--junit-xml` to `databricks pipelines test`, which writes the results of the test run to a JUnit XML report. ([#7299](https://github.com/databricks/cli/pull/7299), [#7434](https://github.com/databricks/cli/pull/7434)) diff --git a/.nextchanges/cli/pipelines-test-results.md b/.nextchanges/cli/pipelines-test-results.md new file mode 100644 index 00000000000..c06ea5d3b17 --- /dev/null +++ b/.nextchanges/cli/pipelines-test-results.md @@ -0,0 +1 @@ +* `databricks pipelines test` waits for the test run and prints the result of each test and a summary. `--no-wait` returns after the run starts. ([#7432](https://github.com/databricks/cli/pull/7432), [#7433](https://github.com/databricks/cli/pull/7433), [#7298](https://github.com/databricks/cli/pull/7298)) diff --git a/.nextchanges/cli/pipelines-test-run-control.md b/.nextchanges/cli/pipelines-test-run-control.md new file mode 100644 index 00000000000..37c5c0c1809 --- /dev/null +++ b/.nextchanges/cli/pipelines-test-run-control.md @@ -0,0 +1 @@ +* Add `--resume` and `--timeout` to `databricks pipelines test`. `--resume` reads the results of an earlier test run without starting a new one. ([#7426](https://github.com/databricks/cli/pull/7426)) From 023ef2f983bd386453e69dec83391d0a916cb13d Mon Sep 17 00:00:00 2001 From: Bhukya Date: Tue, 17 Nov 2026 08:34:10 +0000 Subject: [PATCH 4/6] Link the changelog PR from the moved changelog entries The changelog check requires each entry to link the PR that adds it. Co-authored-by: Isaac --- .nextchanges/cli/pipelines-test-junit.md | 2 +- .nextchanges/cli/pipelines-test-results.md | 2 +- .nextchanges/cli/pipelines-test-run-control.md | 2 +- 3 files changed, 3 insertions(+), 3 deletions(-) diff --git a/.nextchanges/cli/pipelines-test-junit.md b/.nextchanges/cli/pipelines-test-junit.md index 85324e7a638..ce616ad8e01 100644 --- a/.nextchanges/cli/pipelines-test-junit.md +++ b/.nextchanges/cli/pipelines-test-junit.md @@ -1 +1 @@ -* Add `--junit-xml` to `databricks pipelines test`, which writes the results of the test run to a JUnit XML report. ([#7299](https://github.com/databricks/cli/pull/7299), [#7434](https://github.com/databricks/cli/pull/7434)) +* Add `--junit-xml` to `databricks pipelines test`, which writes the results of the test run to a JUnit XML report. ([#7299](https://github.com/databricks/cli/pull/7299), [#7434](https://github.com/databricks/cli/pull/7434), [#7439](https://github.com/databricks/cli/pull/7439)) diff --git a/.nextchanges/cli/pipelines-test-results.md b/.nextchanges/cli/pipelines-test-results.md index c06ea5d3b17..d64ed1c7392 100644 --- a/.nextchanges/cli/pipelines-test-results.md +++ b/.nextchanges/cli/pipelines-test-results.md @@ -1 +1 @@ -* `databricks pipelines test` waits for the test run and prints the result of each test and a summary. `--no-wait` returns after the run starts. ([#7432](https://github.com/databricks/cli/pull/7432), [#7433](https://github.com/databricks/cli/pull/7433), [#7298](https://github.com/databricks/cli/pull/7298)) +* `databricks pipelines test` waits for the test run and prints the result of each test and a summary. `--no-wait` returns after the run starts. ([#7432](https://github.com/databricks/cli/pull/7432), [#7433](https://github.com/databricks/cli/pull/7433), [#7298](https://github.com/databricks/cli/pull/7298), [#7439](https://github.com/databricks/cli/pull/7439)) diff --git a/.nextchanges/cli/pipelines-test-run-control.md b/.nextchanges/cli/pipelines-test-run-control.md index 37c5c0c1809..be2d30d087b 100644 --- a/.nextchanges/cli/pipelines-test-run-control.md +++ b/.nextchanges/cli/pipelines-test-run-control.md @@ -1 +1 @@ -* Add `--resume` and `--timeout` to `databricks pipelines test`. `--resume` reads the results of an earlier test run without starting a new one. ([#7426](https://github.com/databricks/cli/pull/7426)) +* Add `--resume` and `--timeout` to `databricks pipelines test`. `--resume` reads the results of an earlier test run without starting a new one. ([#7426](https://github.com/databricks/cli/pull/7426), [#7439](https://github.com/databricks/cli/pull/7439)) From d6b155f3931e6ed63d8023e4acd876339c6f3159 Mon Sep 17 00:00:00 2001 From: Bhukya Date: Tue, 17 Nov 2026 10:04:09 +0000 Subject: [PATCH 5/6] Drop the experimental gate from the pipelines test changelog entry The gate is removed in #7715. Co-authored-by: Isaac --- .nextchanges/cli/pipelines-test.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/.nextchanges/cli/pipelines-test.md b/.nextchanges/cli/pipelines-test.md index d0bbcff9630..97b89bfa1a4 100644 --- a/.nextchanges/cli/pipelines-test.md +++ b/.nextchanges/cli/pipelines-test.md @@ -1 +1 @@ -* Add the experimental `databricks pipelines test` command. It runs the tests of a pipeline in a test-only update, for a bundle pipeline by its KEY or for any pipeline by `--pipeline-id`. It needs `DATABRICKS_CLI_PIPELINES_TEST=true`. ([#7297](https://github.com/databricks/cli/pull/7297), [#7431](https://github.com/databricks/cli/pull/7431), [#7439](https://github.com/databricks/cli/pull/7439)) +* Add the `databricks pipelines test` command. It runs the tests of a pipeline in a test-only update, for a bundle pipeline by its KEY or for any pipeline by `--pipeline-id`. ([#7297](https://github.com/databricks/cli/pull/7297), [#7431](https://github.com/databricks/cli/pull/7431), [#7439](https://github.com/databricks/cli/pull/7439), [#7715](https://github.com/databricks/cli/pull/7715)) From 6fbbb19c5e001b90f0dd5ab9b76d90dfc8a7e60e Mon Sep 17 00:00:00 2001 From: Bhukya Date: Tue, 17 Nov 2026 15:55:28 +0000 Subject: [PATCH 6/6] Drop the bundle testing variable from the changelog entries Co-authored-by: Isaac --- .nextchanges/bundles/pipelines-testing-plan.md | 2 +- .nextchanges/bundles/pipelines-testing.md | 2 +- 2 files changed, 2 insertions(+), 2 deletions(-) diff --git a/.nextchanges/bundles/pipelines-testing-plan.md b/.nextchanges/bundles/pipelines-testing-plan.md index 6d7b664d750..fa1b1d405bc 100644 --- a/.nextchanges/bundles/pipelines-testing-plan.md +++ b/.nextchanges/bundles/pipelines-testing-plan.md @@ -1 +1 @@ -* With `DATABRICKS_BUNDLE_ENABLE_EXPERIMENTAL_PIPELINE_TESTING=true`, `bundle plan` shows a change to the `testing` property of a pipeline that was made outside the bundle, and `bundle deploy` undoes it. ([#7438](https://github.com/databricks/cli/pull/7438), [#7439](https://github.com/databricks/cli/pull/7439)) +* `bundle plan` shows a change to the `testing` property of a pipeline that was made outside the bundle, and `bundle deploy` undoes it. ([#7438](https://github.com/databricks/cli/pull/7438), [#7439](https://github.com/databricks/cli/pull/7439)) diff --git a/.nextchanges/bundles/pipelines-testing.md b/.nextchanges/bundles/pipelines-testing.md index 403006ce99e..ddab4c4c865 100644 --- a/.nextchanges/bundles/pipelines-testing.md +++ b/.nextchanges/bundles/pipelines-testing.md @@ -1 +1 @@ -* Add the experimental `testing` property of pipelines, with the test sources and test-only dependencies that `databricks pipelines test` runs with. It needs `DATABRICKS_BUNDLE_ENABLE_EXPERIMENTAL_PIPELINE_TESTING=true`. Everyone who deploys the bundle needs this CLI version with the variable set: a deploy from an older CLI that changes the pipeline removes its `testing`. ([#7300](https://github.com/databricks/cli/pull/7300), [#7437](https://github.com/databricks/cli/pull/7437), [#7439](https://github.com/databricks/cli/pull/7439)) +* Add the `testing` property of pipelines, with the test sources and test-only dependencies that `databricks pipelines test` runs with. With `dynamic_version`, test dependencies use the patched wheel. Everyone who deploys the bundle needs this CLI version: a deploy from an older CLI that changes the pipeline removes its `testing`. ([#7300](https://github.com/databricks/cli/pull/7300), [#7437](https://github.com/databricks/cli/pull/7437), [#7439](https://github.com/databricks/cli/pull/7439))