You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
{{ message }}
Repository navigation
[Bug] Parquet reader fails on BLOB restored from ARROW:schema #296
I searched in the issues and found nothing similar.
Paimon-cpp version
main at commit ded7cfb8.
Minimal reproduce step
Use pypaimon==2.0.0 with pyarrow==19.0.1 to write an append-only Paimon table containing a BLOB column.
The generated Parquet file stores the physical column as binary, while its ARROW:schema metadata records the original Arrow type as large_binary.
Read the table with Paimon C++. The Arrow Parquet reader restores the column to large_binary before Paimon applies its physical binary-to-BLOB conversion.
A reproducing fixture is included in test/test_data/parquet/append_types_compatibility.db/python_types.
What doesn't meet your expectations?
The read fails because Paimon C++ strictly compares the restored large_binary source type with the expected physical binary type. These representations are compatible for a Paimon BLOB that has already been restored by ARROW:schema.
Paimon C++ should accept the already-restored large_binary BLOB while continuing to reject unrelated type mismatches.
Anything else?
The compatibility fixtures also cover equivalent tables written by Python, Rust, and Java Paimon. The proposed fix is available in #297.
changed the title [-]Parquet reader fails on BLOB types restored from ARROW:schema[/-][+]Parquet reader fails on BLOB restored from ARROW:schema[/+]on Sep 9, 2026
changed the title [-]Parquet reader fails on BLOB restored from ARROW:schema[/-][+][Bug] Parquet reader fails on BLOB restored from ARROW:schema[/+]on Sep 9, 2026
Activity
[-]Parquet reader fails on BLOB types restored from ARROW:schema[/-][+]Parquet reader fails on BLOB restored from ARROW:schema[/+][-]Parquet reader fails on BLOB restored from ARROW:schema[/-][+][Bug] Parquet reader fails on BLOB restored from ARROW:schema[/+]