Skip to content

mzcompose: Reduce overheads for small runs (33.9s -> 10.2s)#35446

Merged
def- merged 1 commit intoMaterializeInc:mainfrom
def-:pr-speedup-mzcompose-overhead
Mar 12, 2026
Merged

mzcompose: Reduce overheads for small runs (33.9s -> 10.2s)#35446
def- merged 1 commit intoMaterializeInc:mainfrom
def-:pr-speedup-mzcompose-overhead

Conversation

@def-
Copy link
Contributor

@def- def- commented Mar 12, 2026

Targetting downing and upping services

With nothing running: bin/mzcompose --find testdrive down: 1.9s -> 0.5s
With an empty file: bin/mzcompose --find testdrive run default empty.td: 20.0s -> 8.1s
After a run: bin/mzcompose --find testdrive down: 12.0s -> 1.6s

@github-actions
Copy link

Thanks for opening this PR! Here are a few tips to help make the review process smooth for everyone.

PR title guidelines

  • Use imperative mood: "Fix X" not "Fixed X" or "Fixes X"
  • Be specific: "Fix panic in catalog sync when controller restarts" not "Fix bug" or "Update catalog code"
  • Prefix with area if helpful: compute: , storage: , adapter: , sql:

Pre-merge checklist

  • The PR title is descriptive and will make sense in the git log.
  • This PR has adequate test coverage / QA involvement has been duly considered. (trigger-ci for additional test/nightly runs)
  • If this PR includes major user-facing behavior changes, I have pinged the relevant PM to schedule a changelog post.
  • This PR has an associated up-to-date design doc, is a design doc (template), or is sufficiently small to not require a design.
  • If this PR evolves an existing $T ⇔ Proto$T mapping (possibly in a backwards-incompatible way), then it is tagged with a T-proto label.
  • If this PR will require changes to cloud orchestration or tests, there is a companion cloud PR to account for those changes that is tagged with the release-blocker label (example).

@def- def- force-pushed the pr-speedup-mzcompose-overhead branch 9 times, most recently from 493430a to cad269a Compare March 12, 2026 14:59
@def- def- marked this pull request as ready for review March 12, 2026 15:15
@def- def- force-pushed the pr-speedup-mzcompose-overhead branch 2 times, most recently from 8bfb58d to db69fc5 Compare March 12, 2026 15:42
Targetting downing and upping services
@def- def- force-pushed the pr-speedup-mzcompose-overhead branch from db69fc5 to 73a8d67 Compare March 12, 2026 15:48
@def- def- enabled auto-merge (squash) March 12, 2026 15:51
@def- def- merged commit e32161a into MaterializeInc:main Mar 12, 2026
115 checks passed
@def- def- deleted the pr-speedup-mzcompose-overhead branch March 12, 2026 15:55
@def- def- changed the title mzcompose: Reduce overheads for small runs mzcompose: Reduce overheads for small runs (33.9s -> 10.2s) Mar 12, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants