Skip to content

zstd ZSTD_insertBt1 usage too much cpu about 52% #4390

@peterpaule

Description

@peterpaule

we use rocksdb as storage engine and use zstd as compression type; but we found zstd use too much cpu , someone who can help us? thank you;

zstd version:v1.4.0

Activity

changed the title [-]zstd ZSTD_insertBt1 usage too much cpu[/-] [+]zstd ZSTD_insertBt1 usage too much cpu about 52%[/+] on May 23, 2025
Cyan4973

Cyan4973 commented on May 23, 2025

@Cyan4973
Contributor
  • RocksDB has many performance parameters that can be tweaked. Most notably, one can select where to apply compression, which compression level to use (which would directly impact ZSTD_insertBt1(), swapping it for something faster), and even switch zstd for lz4 for more speed. Refer to RocksDB documentation to know and understand them.
  • 1.4.0 is 6+ years old. If that's an option, try to update the library to something more recent, like v1.5.7.
self-assigned this
on May 23, 2025
peterpaule

peterpaule commented on May 26, 2025

@peterpaule
Author

thanks, i will try v1.5.7

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

Labels

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

    Development

    No branches or pull requests

      Participants

      @Cyan4973@peterpaule

      Issue actions

        zstd ZSTD_insertBt1 usage too much cpu about 52% · Issue #4390 · facebook/zstd