Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

upgrade delta-rs to v0.18.0 and deltalake-arrow to 52 #17388

Closed
wenym1 opened this issue Jun 21, 2024 · 4 comments
Closed

upgrade delta-rs to v0.18.0 and deltalake-arrow to 52 #17388

wenym1 opened this issue Jun 21, 2024 · 4 comments
Assignees
Milestone

Comments

@wenym1
Copy link
Contributor

wenym1 commented Jun 21, 2024

Is your feature request related to a problem? Please describe.

The latest delta-rs version 0.18.0 use arrow 52. After #17354, iceberg will also use arrow 52. If the arrow version used internally can also upgrade to 52, then we will be able to unify our multiple arrow version to possibly reduce the build time.

Describe the solution you'd like

No response

Describe alternatives you've considered

No response

Additional context

No response

@xxchan
Copy link
Member

xxchan commented Oct 3, 2024

kindly ping here

@hzxa21
Copy link
Collaborator

hzxa21 commented Oct 8, 2024

cc @xxhZs

@hzxa21 hzxa21 modified the milestones: release-2.0, future-release-2.2 Oct 8, 2024
@xxhZs
Copy link
Contributor

xxhZs commented Oct 8, 2024

cc @xxhZs

Tried this before, but there was a bit of a problem with delta's dependencies at the time, which led to unnecessary arrow packages, will look at it again now!

@xxchan
Copy link
Member

xxchan commented Oct 8, 2024

unnecessary arrow packages

I think currently we are generally tolerant of multiple arrow versions, so it should be fine

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

4 participants