Skip to content

Add a sharding mechanism for streams in order to improve performance when there are a large number of streams #1

Open
@jondubois

Description

@jondubois

Currently, all streams listen to a single source stream and pick up data which is relevant to them.

There needs to be some kind of sharding mechanism (based on stream name) to improve performance when there are a large number of streams - That way each stream only consumes from the source shard which is relevant to them.

...Maybe in some kind of tree hierarchy - That would allow stream-demux to achieve O(log n) time complexity with respect to the number of streams.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions