Parquet file created from pandas cannot be read with compression=“brotli”

[shadowofgost]

Parquet file created from pandas cannot be read with compression=“brotli”

Add support compression codec "BROTLI" will be better

[adamviola]

We're using DuckDB under the hood. Looks like they recently merged support for Brotli compression. Leaving this issue open to update the extension when they make their next release.

[shadowofgost]

We're using DuckDB under the hood. Looks like they recently merged support for Brotli compression. Leaving this issue open to update the extension when they make their next release.
The New version DuckDB is release

[adamviola]

Still waiting on the Node version to get v1.1.0. Here's the MR.

[skyhirider]

Came here to open a feature request, but seems it already exists, so giving my +1 here for brotli.

It takes much longer to create parquet files but the files produced were almost 20% smaller compared to zstd.

Edit: After compressing with zstd compression_level set to 22, the size difference is only 5%.

[DeflateAwning]

This is now supported in my fork, as of v2.1.0: https://github.com/DeflateAwning/flat-file-explorer / https://marketplace.visualstudio.com/items?itemName=DeflateAwning.flat-file-explorer

Feel free to open an issue over there if you have any troubles!

[kcirtapfromspace]

+1 here for brotli support

[shadowofgost]

Still waiting on the Node version to get v1.1.0. Here's the MR.

Node version has already up to date，please add support for brotli