Skip to content

bundle: look up the deployment-history node alongside the remote state reads - #7086

Open
denik wants to merge 1 commit into
denik/state-dir-not-a-filefrom
denik/dms-prefetch-node
Open

denik wants to merge 1 commit into
denik/state-dir-not-a-filefrom
denik/dms-prefetch-node

Conversation

@denik

@denik denik commented Oct 16, 2026 •

Copy link
Copy Markdown
Contributor

Changes

With deployment history configured, readStates now runs the resources.deployment.json get-status concurrently with the resources.json / terraform.tfstate reads and hands the id to fetchDeploymentFromStatePath on StateDesc. The lookup moved to dms.LookupDeploymentID.

Why

plan/deploy/destroy always pull remote state, so with deployment history on they did export → get-status → GetDeployment one after another. Now it is max(export, get-status) → GetDeployment: one round trip less. Follows #7075, which removed the get-status before each state read.

Whether the state records history is only known after reading it, so the lookup is gated on the config; a state that disagrees is rejected or looked up again as before.

Tests

Same requests are made, just concurrently, so no golden changes; DMS acceptance tests pass, 15 repeated runs without ordering flakes.

This pull request and its description were written by Isaac.

@denik
denik requested review from a team as code owners October 16, 2026 09:24
@denik
denik requested a review from pietern October 16, 2026 09:24
@denik
denik added this pull request to stack #7089 October 16, 2026 09:24
@github-actions github-actions Bot added the DABs DABs related issues label Oct 16, 2026
@denik
denik removed this pull request from stack #7089 October 16, 2026 09:31
@denik
denik force-pushed the denik/dms-prefetch-node branch from 79e17eb to bbbc19d Compare October 16, 2026 09:39
@denik
denik changed the base branch from main to denik/state-dir-not-a-file October 16, 2026 09:39
@denik
denik added this pull request to stack #7091 October 16, 2026 09:39
@eng-dev-ecosystem-bot

eng-dev-ecosystem-bot commented Oct 16, 2026 •

Copy link
Copy Markdown
Collaborator

Integration test report

Commit: 81fea9b

Run: 38890886881

Env 🔄​flaky ✅​pass 🙈​skip Time
✅​ aws linux-2core-8gb 279 15 5:54
✅​ aws-windows-latest-4core-16gb 281 13 5:45
✅​ azure linux-2core-8gb 278 15 5:40
✅​ azure-windows-latest-4core-16gb 280 13 5:40
✅​ gcp linux-2core-8gb 279 15 5:42
🔄​ gcp-windows-latest-4core-16gb 1 280 13 5:47
Test Name gcp-windows-latest-4core-16gb
🔄​ TestSyncIncrementalFileOverwritesFolder 🔄​f
Top 6 slowest tests (at least 2 minutes):
duration env testname
5:27 aws-windows-latest-4core-16gb TestAccept
5:22 azure-windows-latest-4core-16gb TestAccept
5:17 gcp-windows-latest-4core-16gb TestAccept
3:51 azure linux-2core-8gb TestAccept
3:50 gcp linux-2core-8gb TestAccept
3:46 aws linux-2core-8gb TestAccept

…e reads

With deployment history configured, plan/deploy/destroy read resources.json and only then
get-status resources.deployment.json to find the deployment id. readStates now runs that
lookup concurrently with the state reads and passes the result on StateDesc, saving one
sequential round trip.

Co-authored-by: Isaac <no-reply@databricks.com>
@denik
denik force-pushed the denik/dms-prefetch-node branch from bbbc19d to 81fea9b Compare October 16, 2026 10:57

This branch has not been deployed

No deployments
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

DABs DABs related issues

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants