Skip to content

IndexingSplitStore copies local files that could be moved #6447

@guilload

Description

@guilload

Splits are staged on local fs before being uploaded. When the index dir targets the same file://... fs, splits can simply be moved. However, the IndexingSplitStore copies them. The Uploader calls IndexingSplitStore::store_split which in turn calls Storage::put. For LocalFileStorage, put is implemented as a copy.

Low priority because production deployments use object storage, but nice to fix.

Metadata

Metadata

Assignees

No one assigned

    Labels

    bugSomething isn't working

    Type

    No type
    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions