Add `GatherToZarr` and save pipeline node extension data to disk - #4703

Open

alejoe91 wants to merge 34 commits into

SpikeInterface:mainfrom

alejoe91:gather-to-zarr

Commits on Jun 15, 2026

wip: lazy load (analyzer + extensions)
alejoe91
committed
3385cf2

Commits on Jun 19, 2026

todo
alejoe91
committed
121a055

Commits on Jun 24, 2026

feat: move lazy logic to load only
alejoe91
committed
6fdd194
Merge branch 'main' into lazy-extensions
alejoe91
authored
1b82c87
test: add tests for lazy mode
alejoe91
committed
10dfd9f
Merge branch 'lazy-extensions' of github.com:alejoe91/spikeinterface into lazy-extensions
alejoe91
committed
1a1e197
feat: implement ZarrSpikeVector - a memmap like lazy spike vector for zarr
alejoe91
committed
21a6a59
fix: add lazy spike vector as kwarg
alejoe91
committed
e1a1e75

Commits on Jun 29, 2026

Merge branch 'main' into lazy-extensions
chrishalcrow
authored
6187b31

Commits on Jul 2, 2026

Merge branch 'main' into lazy-extensions
alejoe91
authored
8e1bcf7

Commits on Jul 17, 2026

fix: conflicts
alejoe91
committed
e44a9bd
Merge branch 'lazy-extensions' of github.com:alejoe91/spikeinterface into lazy-extensions
alejoe91
committed
66cd624

Commits on Jul 21, 2026

fix: don't copy extension data if sorting_analyzer is lazy
alejoe91
committed
b710917
fix: save=False in compute if analyzer is lazy
alejoe91
committed
6fa122a
feat: add gather to zarr in node pipeline
alejoe91
committed
09ae857
fix: only delete extension folders if not lazy
alejoe91
committed
080b17e
feat: GatherToZarr and save extension data in chunks to disk
alejoe91
committed
1b6a82c
fix: solve conflicts
alejoe91
committed
ae1b5e4
fix: conflicts
alejoe91
committed
d7e025b

Commits on Jul 23, 2026

Commits on Jul 24, 2026

Merge branch 'main' into gather-to-zarr
alejoe91
authored
8d76262

Commits on Sep 11, 2026

fix: conflicts and simplify target bytes in gather to zarr
alejoe91
committed
619911c
Merge branch 'main' of github.com:SpikeInterface/spikeinterface into gather-to-zarr
alejoe91
committed
ac7a075
Apply suggestion from @samuelgarcia

alejoe91
and
samuelgarcia
authored
46efb7d
[pre-commit.ci] auto fixes from pre-commit.com hooks
pre-commit-ci[bot]
committed
6511363
oups
alejoe91
committed
efeacdd
Merge branch 'gather-to-zarr' of github.com:alejoe91/spikeinterface into gather-to-zarr
alejoe91
committed
e7e723a

Commits on Sep 16, 2026