feat(batch): support batch read iceberg source #15214
+195
−77
Merged
Task list completed / task-list-completed
Started
2024-02-27 08:06:28
ago
0 / 8 tasks completed
8 tasks still to be completed
Details
Required Tasks
| Task | Status |
|---|---|
| Related issue #14742 | Incomplete |
| Support iceberg source batch read. Iceberg must be a COW table or contain no deleted files. | Incomplete |
| Batch scheduler splits iceberg files evenly based on batch parallelism. | Incomplete |
| I have written necessary rustdoc comments | Incomplete |
| I have added necessary unit tests and integration tests | Incomplete |
| I have added test labels as necessary. See details. | Incomplete |
| I have added fuzzing tests or opened an issue to track them. (Optional, recommended for new SQL features #7934). | Incomplete |
| My PR contains breaking changes. (If it deprecates some features, please create a tracking issue to remove them in the future). | Incomplete |
All checks passed in ./risedev check (or alias, ./risedev c) |
Incomplete |
| My PR contains critical fixes that are necessary to be merged into the latest release. (Please check out the details) | Incomplete |
| My PR needs documentation updates. (Please use the Release note section below to summarize the impact on users) | Incomplete |
| Support create iceberg source. | Incomplete |
| Support batch read iceberg source. | Incomplete |
Currently, only catalog.type = 'storage' is supported in iceberg source |
Incomplete |
| Understand the implications of revoking this secret by investigating where it is used in your code. | Incomplete |
| Replace and store your secret safely. Learn here the best practices. | Incomplete |
| Revoke and rotate this secret. | Incomplete |
| If possible, rewrite git history. Rewriting git history is not a trivial act. You might completely break other contributing developers' workflow and you risk accidentally deleting legitimate data. | Incomplete |
| following these best practices for managing and storing secrets including API keys and other credentials | Incomplete |
| install secret detection on pre-commit to catch secret before it leaves your machine and ease remediation. | Incomplete |
Loading