Skip to content

Deduplicate remote fetches for generate inputs - #4686

Open
emcfarlane wants to merge 2 commits into
mainfrom
ed/dedupeFetch
Open

emcfarlane wants to merge 2 commits into
mainfrom
ed/dedupeFetch

Conversation

@emcfarlane

@emcfarlane emcfarlane commented Sep 16, 2026

Copy link
Copy Markdown
Contributor

This adds caching to remote references so buf generate now fetches each remote input once. Multiple inputs in a buf.gen.yaml that resolve to the same archive, git repository, or image previously fetched once per input. The cache is opt-in and set per command required.

Closes #4657

@github-actions

github-actions Bot commented Sep 16, 2026

Copy link
Copy Markdown
Contributor

The latest Buf updates on your PR. Results from workflow Buf CI / buf (pull_request).

BuildFormatLintBreakingUpdated (UTC)
✅ passed✅ passed✅ passed✅ passedSep 16, 2026, 4:12 PM

@emcfarlane
emcfarlane requested a review from doriable September 16, 2026 15:46

@doriable doriable left a comment

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Since this would be using an in-memory cache, we need to do some validation for the LSP on memory consumption and include that in some combination of the PR description or in a test.

@emcfarlane emcfarlane changed the title Deduplicate Ref fetches Deduplicate remote fetches for generate inputs Sep 16, 2026
@emcfarlane
emcfarlane requested a review from doriable September 16, 2026 16:15
@emcfarlane

Copy link
Copy Markdown
Contributor Author

@doriable thanks added option config for setting per command.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Deduplicate identical remote fetches across inputs: entries in buf.gen.yaml

2 participants