fs2-kafka v0.20.2

Changes

• Add support for creating, describing, and deleting ACLs. Thanks @novakov-alexey! (#250, #251)

Updates

• Update fs2 to 2.0.1. (#219)
• Update kafka to 2.3.1. (#252)
• Update scala to 2.12.10. (#226)
• Update vulcan to 0.2.2. Thanks @scala-steward! (#227)

Miscellaneous

• Update sbt to 1.3.3. (#242)
• Update sbt-mdoc to 1.3.5. Thanks @scala-steward! (#230)
• Update sbt-mima-plugin to 0.6.1. Thanks @scala-steward! (#216)
• Update sbt-release to 1.0.12. Thanks @scala-steward! (#243)
• Update sbt-scalafmt to 2.2.1. Thanks @scala-steward! (#248)
• Update sbt-sonatype to 3.8. Thanks @scala-steward! (#225)
• Update scalafmt-core to 2.2.1. Thanks @scala-steward! (#245)

Released on 2019-10-29.

fs2-kafka v0.20.1

Changes

• Add Timestamp#unknownTime. Thanks @chenharryhua! (#197, #213)
• Fix potential consumer stalling by reverting #180. Thanks @jferris! (#215)

Miscellaneous

• Update sbt-sonatype to 3.7. Thanks @scala-steward! (#212)
• Update sbt-scalafmt to 2.0.5. Thanks @scala-steward! (#214)

Released on 2019-09-19.

fs2-kafka v0.20.0

Changes

• Add describeConfigs to KafkaAdminClient. Thanks @BenFradet! (#196)
• Change the default producer setting max.retries to 0. (#211)

Updates

• Update cats-effect to 2.0.0. Thanks @scala-steward! (#208)
• Update fs2 to 2.0.0. Thanks @scala-steward! (#209)
• Update kafka-avro-serializer to 5.3.1. Thanks @scala-steward! (#210)
• Update vulcan to 0.2.0. Thanks @scala-steward! (#207)

Documentation

• Add documentation for the KafkaAdminClient. Thanks @BenFradet! (#201)

Miscellaneous

• Update sbt to 1.3.0. Thanks @scala-steward! (#199)
• Update sbt-sonatype to 3.6. Thanks @scala-steward! (#204)
• Update scalatestplus-scalacheck to 3.1.0.0-RC2. Thanks @scala-steward! (#206)

Released on 2019-09-11.

fs2-kafka v0.20.0-RC1

Changes

• Add alterConfigs to KafkaAdminClient. Thanks @joceron! (#158)
• Add assignmentStream to KafkaConsumer. Thanks @danxmoran! (#169)
• Add Auth.Bearer for authentication token support in fs2-kafka-vulcan. (#176)
• Add createPartitions to KafkaAdminClient. Thanks @BenFradet! (#191)
• Add deleteTopic and deleteTopics to KafkaAdminClient. Thanks @BenFradet! (#192)
• Add Serializer.Record and Deserializer.Record for key/value-specific serializers. (#177)
• Add withGroupInstanceId to ConsumerSettings. (#178)
• Change to convert to Chunk in CommittableProducerRecords, ProducerRecords, and ProducerResult. Thanks @danxmoran! (#174, #187)
• Change to prioritize polls over other requests. (#180)
• Change to use TransactionalProducerSettings for TransactionalKafkaProducer. Thanks @danxmoran! (#186)
• Fix incorrect poll assertion potentially causing IllegalStateExceptions. Thanks @Fristi! (#194)
• Move isKey from AvroSettings to Serializer.Record and Deserializer.Record. (#177)

Updates

• Update cats to 2.0.0-RC2. (#195)
• Update cats-effect to 2.0.0-RC2. (#195)
• Update kafka-avro-serializer to 5.3.0. Thanks @scala-steward! (#163)
• Update vulcan to 0.2.0-RC2. Thanks @scala-steward! (#188)

Documentation

• Add documentation on how to share a schema registry client instance. (#179)
• Add more documentation on KafkaProducer#produce. Thanks @SystemFw! (#193)
• Add note on Confluent resolver. Thanks @mosman128 and @justinhj! (#159, #161)

Miscellaneous

• Update better-monadic-for to 0.3.1. Thanks @scala-steward! (#162)
• Update sbt-mdoc to 1.3.2. Thanks @scala-steward! (#185)
• Update sbt-mima-plugin to 0.6.0. Thanks @scala-steward! (#184)
• Update sbt-scalafmt to 2.0.4. Thanks @scala-steward! (#189)
• Update scalafmt to 2.0.1. Thanks @scala-steward! (#181)

Released on 2019-08-30.

fs2-kafka v0.20.0-M2

Changes

• Add fs2-kafka-vulcan for integration with vulcan. (#156)

Released on 2019-07-12.

fs2-kafka v0.20.0-M1

Overview

This release introduces several breaking changes to binary- and source-compatibility.
Note binary- and source-compatibility is not guaranteed between milestone releases.

Changes

• Add ConsumerSettings#withAllowAutoCreateTopics and withClientRack. (#153)
• Add producer with support for Kafka transactions. Thanks @danxmoran! (#128, #130, #144, #146)
• Add support for Scala 2.13. (#151, #154)
• Change Deserializer to support deserialization effects. (#120, #122, #131, #135)
  • Deserializer[A] is now Deserializer[F[_], A] with Sync[F].
  • ConsumerSettings[K, V] is now ConsumerSettings[F[_], K, V].
  • For Java Kafka Deserializer interoperability, refer to the documentation.
• Change KafkaAdminClient to use a blocking ExecutionContext. (#141)
  • Changed to Blocker as part of #150.
• Change Serializer to support serialization effects. (#118, #119, #122, #136)
  • Serializer[A] is now Serializer[F[_], A] with Sync[F].
  • ProducerSettings[K, V] is now ProducerSettings[F[_], K, V].
  • For Java Kafka Serializer interoperability, refer to the documentation.
• Change default auto.offset.reset to none in ConsumerSettings. (#121)
• Change to expose more Java Kafka type aliases. (#133)
• Change to parameterize AdminClientSettings on the effect type. (#125)
  • AdminClientSettings is now AdminClientSettings[F[_]] with Sync[F].
• Change to remove the concept of messages. (#144)
  • Rename ProducerMessage to ProducerRecords.
  • Rename CommittableMessage#committableOffset to offset.
  • Rename CommittableMessage to CommittableConsumerRecord.
• Change to simplify produce and commit with produce pipe. (#146)
  • Change KafkaProducer to no longer be sealed.
  • Remove KafkaProducer#producePassthrough.
  • Remove most batch commit pipes: commitBatch, commitBatchF, commitBatchOption, commitBatchOptionF, commitBatchChunk, commitBatchChunkF, commitBatchChunkOption, commitBatchChunkOptionF, commitBatchWithinF, and commitBatchOptionWithin, commitBatchOptionWithinF.
• Change to support creation effect for serializers. (#142)
• Change to use Blocker over ExecutionContext in settings. (#150)
  • ConsumerSettings#executionContext is now instead blocker.
  • ConsumerSettings#withExecutionContext is now withBlocker.
  • Similar changes to ProducerSettings and AdminClientSettings.
• Prevent mixing consumer group ids in the same CommittableOffsetBatch. (#148)
• Remove Header#headers. (#147)
• Remove functions for creating ExecutionContexts. (#145)
  • Removes the following functions: consumerExecutionContextResource, consumerExecutionContextStream, producerExecutionContextResource, producerExecutionContextStream, adminClientExecutionContextResource, and adminClientExecutionContextStream.
• Remove serialization support for org.apache.kafka.common.utils.Bytes. (#139)
• Remove the ProducerMessage[F].of syntax. (#134)
  • There is also no ProducerRecords[F].of after rename in #144.

Updates

• Update FS2 to 1.1.0-M1. (#149)
• Update Kafka to 2.3.0. (#153)

Documentation

• Add initial consumer documentation. (#138)
• Add initial producer documentation. (#152)
• Add initial transactions documentation. (#152)

Internals

• Change KafkaConsumerActor to not store records internally. (#129)
• Change to use internal WithConsumer construct. (#124)

Released on 2019-07-04.

fs2-kafka v0.19.9

Changes

• Change to handle commits during rebalancing. Thanks @CremboC! (#117)

Released on 2019-04-03.

fs2-kafka v0.19.8

Additions

• Add initial debug logging using SLF4J. Thanks @backuitist! (#108, #113)

Changes

• Change to only pause/resume partitions when necessary. (#112)
• Change to only start polling after streaming has started. Thanks @Krever! (#110, #114)
• Change to revoke previous duplicate fetch and issue warning log. Thanks @backuitist! (#107)
• Fix race condition which could cause duplicate records. (#111)

Released on 2019-04-02.

fs2-kafka v0.19.7

Changes

• Fix to include state changes during poll when handling records. (#109)

Released on 2019-03-29.

fs2-kafka v0.19.6

Changes

• Fix a race condition which could result in duplicate records. Thanks @backuitist! (#105, #106)

Released on 2019-03-28.