Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat(compaction): Support full compaction at table granularity #14209

Open
Li0k opened this issue Dec 26, 2023 · 1 comment
Open

feat(compaction): Support full compaction at table granularity #14209

Li0k opened this issue Dec 26, 2023 · 1 comment
Assignees

Comments

@Li0k
Copy link
Contributor

Li0k commented Dec 26, 2023

In hummock, automatically triggered compaction and manual compaction are supported to meet the needs of most scenarios.
However, each time manual compaction is initiated, only one compact task is triggered, which cannot meet the needs of full compaction.

In what scenarios does Full Compaction need to be introduced?

  1. When there is a large amount of redundant data in hummock, it needs to be cleaned.
  2. When a table_id contains a large number of stale keys, it needs to be cleaned immediately to improve query performance.
  3. When testing, it is necessary to verify whether the newly introduced compaction cleaning logic can work.
  4. When under low load, we can trigger full compaction to reorganize the data in hummock.

feat request:

  1. trigger full compaction at table granularity via SQL request by @chenzl25
  2. trigger full compaction to verify the table-watermark cleaning capabilities request by @wenym1
@github-actions github-actions bot added this to the release-1.6 milestone Dec 26, 2023
@fuyufjh fuyufjh modified the milestones: release-1.6, release-1.7 Jan 9, 2024
Copy link
Contributor

This issue has been open for 60 days with no activity. Could you please update the status? Feel free to continue discussion or close as not planned.

@Li0k Li0k removed this from the release-1.7 milestone Mar 25, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

2 participants