Skip to content

New stream method with the full rebalance information #876

@LMnet

Description

@LMnet

After an #844 partitionsMapStream is no more a "Stream where each element contains a current assignment" as was mentioned in the scala doc previously.

It looks like if we want to retain such functionality, we need to add a new stream method like this:

def detailedDataStream: Stream[F, FullAssigmnentInfo[F, K, V]]

case class FullAssigmnentInfo[F[_], K, V](
  newlyAssignedPartitions: Map[TopicPartition, Stream[F, CommittableConsumerRecord[F, K, V]],
  revokedPartitions: SortedSet[TopicPartition],
  retainedPartitions: SortedSet[TopicPartition],
)

Naming is not final, just my thoughts.

Metadata

Metadata

Assignees

No one assigned

    Labels

    enhancementNew feature or request

    Type

    No type

    Projects

    No projects

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions