Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[v24.3.x] storage: check for may_have_tombstones in self_compact_segment (manual backport) #24500

Merged

Conversation

WillemKauf
Copy link
Contributor

@WillemKauf WillemKauf commented Dec 9, 2024

Backport of commit 1f5f363.

Segments that may have tombstone records in them should still be considered eligible for self compaction.

An early return statement was missing a check for this condition. Add it so that tombstones will be properly removed for a segment eligible for removal.

Also adjusts a vassert() to account for this case.

Backports Required

  • none - not a bug fix
  • none - this is a backport
  • none - issue does not exist in previous branches
  • none - papercut/not impactful enough to backport
  • v24.3.x
  • v24.2.x
  • v24.1.x

Release Notes

Bug Fixes

  • Fixes a bug in which segments which may have tombstones in them were not considered eligible for self-compaction.

Segments that may have tombstone records in them should still be
considered eligible for self compaction.

An early return statement was missing a check for this condition.
Add it so that tombstones will be properly removed for a segment
eligible for removal.

Also adjusts a `vassert()` to account for this case.

(cherry picked from commit 1f5f363)
Copy link
Contributor

@andrwng andrwng left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

rptest: add log_compaction_test.py

Seems like there were quite a few functional changes in the original PR. Please retroactively add some release notes to the original PR, and to this backport

@WillemKauf
Copy link
Contributor Author

Seems like there were quite a few functional changes in the original PR. Please retroactively add some release notes to the original PR, and to this backport

Done, thanks

@vbotbuildovich
Copy link
Collaborator

vbotbuildovich commented Dec 10, 2024

@WillemKauf WillemKauf merged commit ce4bb46 into redpanda-data:v24.3.x Dec 10, 2024
18 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants