POC: Parallel LPT buckets - #8496
Draft
webard wants to merge 3 commits into
Draft
Conversation
webard
marked this pull request as draft
September 14, 2026 18:50
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Created with the help of Claude.
A proof of concept for testing, not a merge candidate. No tests yet, an opt-in experimental flag, and one unresolved trade-off (memory) that would have to be settled before this could ship. Opening it to put the approach and the numbers in front of people who can try it on their own codebases.
Follows up on #8494, and specifically @samsonasik's comment there: #8494 (comment)
All of it behind
--lpt, opt-in. Without the flag the default path is untouched.jobSizesweep, LPT + stealing, 14 workers:Best current 152.2 s → best
--lpt90.7 s, i.e. -40 %. At identical worker count andjobSize, -25 %.Every run produces the same 3 338 diffs (sha over the file-sorted diff list) and the same 2 errors, except
jobSize: 150.