Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[FEA] Support lz4_raw #14126

Closed
sameerz opened this issue Sep 19, 2023 · 1 comment
Closed

[FEA] Support lz4_raw #14126

sameerz opened this issue Sep 19, 2023 · 1 comment
Labels
0 - Backlog In queue waiting for assignment cuIO cuIO issue feature request New feature or request libcudf Affects libcudf (C++/CUDA) code.

Comments

@sameerz
Copy link
Contributor

sameerz commented Sep 19, 2023

Is your feature request related to a problem? Please describe.
Parquet will deprecate support for lz4 and add support for lz4_raw, per https://issues.apache.org/jira/browse/PARQUET-2032 .

Describe the solution you'd like
This is a request for cuIO to supoprt lz4_raw

Describe alternatives you've considered
lz4 is not currently supported, we could continue to fall back to the CPU for lz4* encoded Parquet.

Additional context
Add any other context, code examples, or references to existing implementations about the feature request here:
Parquet jira: [Format] Add interoperable LZ4 codec, deprecate existing LZ4 codec
Parquet mailing ilst: Request deprecation / removal of LZ4 compression

@sameerz sameerz added feature request New feature or request Needs Triage Need team to review and classify labels Sep 19, 2023
@GregoryKimball GregoryKimball added 0 - Backlog In queue waiting for assignment libcudf Affects libcudf (C++/CUDA) code. cuIO cuIO issue and removed Needs Triage Need team to review and classify labels Nov 9, 2023
@GregoryKimball GregoryKimball moved this to To be revisited in libcudf Nov 9, 2023
@vuule
Copy link
Contributor

vuule commented Mar 12, 2024

@sameerz can we close this one? Looks like #14906 implemented the requested feature.

@sameerz sameerz closed this as completed Mar 13, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
0 - Backlog In queue waiting for assignment cuIO cuIO issue feature request New feature or request libcudf Affects libcudf (C++/CUDA) code.
Projects
Archived in project
Development

No branches or pull requests

3 participants