Skip to content

Investigate how to handle examining files as part of compaction planning #3526

@keith-turner

Description

@keith-turner

As part of selecting files to compact for user compactions the compaction selector plugin offered examining summaries and sample data as part of this decision. This data supported use cases like the TooManyDeletesSelector which could trigger a full tablet compaction when the ratio of deletes in a tablet exceeded a certain threshold.

When the examination ran in tablet servers this examination had much more CPU and memory available than what will be available when running the examination in the manager. In #3513 which moved user compaction from tablet server to the manager this functionality was not implemented because of concerns about resources.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    Status

    No status

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions