Skip to content

dbt-materialize: reduce catalog server load during blue/green deploys#35437

Open
bobbyiliev wants to merge 1 commit intoMaterializeInc:mainfrom
bobbyiliev:dbt-deploy-reduce-catalog-load
Open

dbt-materialize: reduce catalog server load during blue/green deploys#35437
bobbyiliev wants to merge 1 commit intoMaterializeInc:mainfrom
bobbyiliev:dbt-deploy-reduce-catalog-load

Conversation

@bobbyiliev
Copy link
Contributor

Consolidate per-cluster sequential polling in deploy_await into a single WHERE IN query across all deployment clusters, reducing catalog server load by Nx during blue/green deploys.

@github-actions
Copy link

Thanks for opening this PR! Here are a few tips to help make the review process smooth for everyone.

PR title guidelines

  • Use imperative mood: "Fix X" not "Fixed X" or "Fixes X"
  • Be specific: "Fix panic in catalog sync when controller restarts" not "Fix bug" or "Update catalog code"
  • Prefix with area if helpful: compute: , storage: , adapter: , sql:

Pre-merge checklist

  • The PR title is descriptive and will make sense in the git log.
  • This PR has adequate test coverage / QA involvement has been duly considered. (trigger-ci for additional test/nightly runs)
  • If this PR includes major user-facing behavior changes, I have pinged the relevant PM to schedule a changelog post.
  • This PR has an associated up-to-date design doc, is a design doc (template), or is sufficiently small to not require a design.
  • If this PR evolves an existing $T ⇔ Proto$T mapping (possibly in a backwards-incompatible way), then it is tagged with a T-proto label.
  • If this PR will require changes to cloud orchestration or tests, there is a companion cloud PR to account for those changes that is tagged with the release-blocker label (example).

@bobbyiliev bobbyiliev marked this pull request as ready for review March 11, 2026 18:41
@bobbyiliev bobbyiliev requested a review from a team as a code owner March 11, 2026 18:41
@bobbyiliev bobbyiliev requested review from def- and teskje March 11, 2026 18:42
Copy link
Contributor

@teskje teskje left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This all looks plausible to me! I don't really have experience with dbt, so not sure how much that is worth 😅

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants