You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Since most high-level end users use the default parameters, I think this is a very bad footgun, and users will think Datafusion is doing something wrong.
To Reproduce
Expected behavior
Parquet files should be written with some compression by default. I'd suggest ZSTD.
Additional context
Add any other context about the problem here.
The text was updated successfully, but these errors were encountered:
Describe the bug
Currently, the default parameters when writing to Parquet are no compression
datafusion-python/python/datafusion/dataframe.py
Lines 620 to 625 in 79c22d6
Since most high-level end users use the default parameters, I think this is a very bad footgun, and users will think Datafusion is doing something wrong.
To Reproduce
Expected behavior
Parquet files should be written with some compression by default. I'd suggest ZSTD.
Additional context
Add any other context about the problem here.
The text was updated successfully, but these errors were encountered: