feat: project Spark 4 VARIANT columns in native Parquet scans - #5407

Open

peterxcli wants to merge 10 commits into

apache:mainfrom

peterxcli:feat/native-variant-proj

Commits on Aug 21, 2026

feat: project Spark 4 VARIANT columns in native Parquet scans
peterxcli
committed
45a0ed4

Commits on Aug 22, 2026

review
peterxcli
committed
784c316

Commits on Aug 23, 2026

review
peterxcli
committed
c355fef
add link about spark and arrow-rs issue that need to be fixed so we can get cleaner code
peterxcli
committed
c556a52
update spark issue link
peterxcli
committed
9742a7b

Commits on Aug 24, 2026

Merge branch 'main' into feat/native-variant-proj
peterxcli
authored
0a079de
widen unsigned shredded field
peterxcli
committed
33e513c

Commits on Aug 25, 2026

fix: preserve Spark Variant compatibility when unshredding
peterxcli
committed
ed39c4c

Commits on Aug 26, 2026