Improve Controller ingestFromURI filesystem validation - #19238
Draft
xiangfu0 wants to merge 1 commit into
Draft
Conversation
Codecov Report✅ All modified and coverable lines are covered by tests.
Additional details and impacted files@@ Coverage Diff @@
## master #19238 +/- ##
============================================
- Coverage 66.97% 57.73% -9.25%
+ Complexity 1417 1 -1416
============================================
Files 3453 2656 -797
Lines 218858 159139 -59719
Branches 34787 26098 -8689
============================================
- Hits 146591 91873 -54718
+ Misses 60556 59473 -1083
+ Partials 11711 7793 -3918
Flags with carried forward coverage won't be shown. Click here to find out more. ☔ View full report in Codecov by Harness. 🚀 New features to boost your workflow:
|
xiangfu0
force-pushed
the
xiangfu0/ingest-uri-local-fs-hardening-master
branch
from
August 13, 2026 09:04
974e777 to
f02926f
Compare
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
ingestFromURIlocal-filesystem policy by resolving and validating the exact filesystem before ingestion work startsExisting behavior on master
Master already contains
dd6520c7267/ #18660, which introduced the default-off setting and the initial direct URI and class checks. This change builds on that implementation to cover remaining delegate, lifecycle, ordering, and error-handling cases.Behavior before this change
Filesystem selection could happen during copying, and endpoint-provided implementations were registered in shared factory state. Rejected requests could also create Controller staging directories before source validation.
Testing
PinotFSFactoryTestControllerConfTestFileIngestionHelperTestPinotIngestionRestletResourceStatelessTestHadoopPinotFSTestpinot-spi,pinot-controller, andpinot-hdfs