Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Tracking: Iceberg engine table #19418

Open
8 of 17 tasks
chenzl25 opened this issue Nov 18, 2024 · 0 comments
Open
8 of 17 tasks

Tracking: Iceberg engine table #19418

chenzl25 opened this issue Nov 18, 2024 · 0 comments

Comments

@chenzl25
Copy link
Contributor

chenzl25 commented Nov 18, 2024

Milestone 1

#19577

  • create table (non-atomic ddl) including creating a hummock table, iceberg sink, external iceberg table, and iceberg source.
  • drop table (non-atomic ddl) including dropping a hummock table, iceberg sink, external iceberg table, and iceberg source.
  • direct DQL to the iceberg source.
  • direct DML to the hummoc table.
  • allows for creating a materialized view on top of the table with an iceberg engine.
  • iceberg catalog: SQL/JDBC catalog
  • iceberg warehouse: S3

MileStone 2

MileStone 3

  • Rust based compaction and expiration
  • local disk cache for iceberg table meta and data
  • iceberg batch query performance (including predicate pushdown and merge on read)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

1 participant