Skip to content

Excessive memory consumption when using ZSTD to receive compressed data #11824

@djluck

Description

@djluck

Describe the bug
We've seen excessive memory consumption that leads to OOMs when receiving ZSTD-compressed data.

Steps to reproduce

  1. Enable zstd compression for the HTTP exporter in an upstream collector
  2. Observe OOMs in your receiving collector!

You can observe excessive memory via pprof:
image

What version did you use?
v0.114.0

Metadata

Metadata

Assignees

No one assigned

    Labels

    bugSomething isn't working

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions