Skip to content

Use pqarrow in zio/parquetio#4547

Merged
nwt merged 1 commit intomainfrom
pqarrow
Apr 27, 2023
Merged

Use pqarrow in zio/parquetio#4547
nwt merged 1 commit intomainfrom
pqarrow

Conversation

@nwt
Copy link
Copy Markdown
Member

@nwt nwt commented Apr 25, 2023

Reading and writing are much faster with it than with github.com/fraugster/parquet-go. Its only apparent drawback is that it offers no easy way to support Zed's duration and float16 types, and writing a value containing either produces a cryptic error.

$ echo '{a:1.(float16)}' | zq -f parquet -
parquetio: unsupported type: not implemented yet

Closes #764, closes #4278, and closes #4527.

Loading
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Zed can't read Parquet output from DuckDB Replace zio/parquetio with zio/arrowio and pqarrow Support "Avro Old List Structure" in Parquet reader

3 participants