Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

added Pause option into minor compactions #5289

Open
wants to merge 4 commits into
base: main
Choose a base branch
from

Conversation

ArbaazKhan1
Copy link
Contributor

Added a check in MinorCompactionTask to ensure that the current number of files being set to compact are below the Pause property threshold.

@kevinrr888 kevinrr888 linked an issue Jan 28, 2025 that may be closed by this pull request
@kevinrr888 kevinrr888 added this to the 4.0.0 milestone Jan 28, 2025
@@ -603,9 +603,9 @@ private MinorCompactionTask createMinorCompactionTask(long flushId,
logMessage.append(" tabletMemory.memoryReservedForMinC() "
+ getTabletMemory().memoryReservedForMinC());
}
if (getTabletMemory() != null && getTabletMemory().getMemTable() != null) {
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Was this unreachable code?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

no, removing this was a mistake made when I was adding the conditional for pause limit.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looking at it now wouldn't getTabletMemory().getMemTable() always be null when getTabletMemory() is null?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Hold minor compactions when tablets files exceed pause limit
4 participants