fs2-kafka v1.0.0

Changes

• Change to not include scoped dependencies in pom (#313) @vlovgr

Updates

• Update fs2-core to 2.2.1 (#314) @scala-steward
• Update vulcan to 1.0.1 (#315) @scala-steward

Miscellaneous

• Update discipline-scalatest to 1.0.0-RC4 (#311) @vlovgr
• Update sbt to 1.3.7 (#307) @scala-steward

fs2-kafka v1.0.0-RC1

Changes

• Add apply functions for AvroSerializer and AvroDeserializer (#270) @bplommer
• Add additional consumer functionality (#273) @vavr
• Add extractors for CommittableConsumerRecord and Header (#266) @hmagrahi
• Change default ProducerSettings#parallelism to 10000 (#303) @vlovgr
• Change group id to com.github.fd4s (#301) @vlovgr
• Change to ensure revoked partition records are removed (#302) @vlovgr
• Change to maintain binary compatibility across minor versions (#306) @vlovgr
• Change to use writer schema from schema registry for deserialization (#282) @bplommer
• Rename Serializer.Record and Deserializer.Record (#304, #269) @vlovgr @bplommer

Updates

• Update confluent serializer to 5.4.0 (#300) @vlovgr
• Update fs2 to 2.1.0 (#255) @scala-steward
• Update kafka to 2.4.0 (#300) @vlovgr
• Update scala to 2.13.1 (#262) @vlovgr
• Update vulcan to 1.0.0-RC1 (#305) @vlovgr

Miscellaneous

• Change to use sbt-ci-release (#283) @vlovgr
  • A snapshot release is now being published for every push to the master branch.
  • The signing key for release artifacts has changed to E97C 64AB 4987 7F74.
• Remove direct dependency on scalatest (#298) @vlovgr
• Remove release notes in favour of github releases (#287) @vlovgr
• Update discipline-scalatest to 1.0.0-RC2 (#297) @scala-steward
• Update embedded-kafka to 2.4.0 (#300) @vlovgr
• Update sbt to 1.3.6 (#290) @scala-steward
• Update sbt-ci-release to 1.5.0 (#292) @scala-steward
• Update sbt-gpg to 0.2.1 (#268) @scala-steward
• Update sbt-header to 5.4.0 (#296) @scala-steward
• Update sbt-mdoc to 2.1.1 (#295) @scala-steward
• Update sbt-scalafmt to 2.3.0 (#275) @scala-steward
• Update sbt-sonatype to 3.8.1 (#263) @scala-steward
• Update years in copyright license (#293) @vlovgr

fs2-kafka v0.20.2

Changes

• Add support for creating, describing, and deleting ACLs. Thanks @novakov-alexey! (#250, #251)

Updates

• Update fs2 to 2.0.1. (#219)
• Update kafka to 2.3.1. (#252)
• Update scala to 2.12.10. (#226)
• Update vulcan to 0.2.2. Thanks @scala-steward! (#227)

Miscellaneous

• Update sbt to 1.3.3. (#242)
• Update sbt-mdoc to 1.3.5. Thanks @scala-steward! (#230)
• Update sbt-mima-plugin to 0.6.1. Thanks @scala-steward! (#216)
• Update sbt-release to 1.0.12. Thanks @scala-steward! (#243)
• Update sbt-scalafmt to 2.2.1. Thanks @scala-steward! (#248)
• Update sbt-sonatype to 3.8. Thanks @scala-steward! (#225)
• Update scalafmt-core to 2.2.1. Thanks @scala-steward! (#245)

Released on 2019-10-29.

fs2-kafka v0.20.1

Changes

• Add Timestamp#unknownTime. Thanks @chenharryhua! (#197, #213)
• Fix potential consumer stalling by reverting #180. Thanks @jferris! (#215)

Miscellaneous

• Update sbt-sonatype to 3.7. Thanks @scala-steward! (#212)
• Update sbt-scalafmt to 2.0.5. Thanks @scala-steward! (#214)

Released on 2019-09-19.

fs2-kafka v0.20.0

Changes

• Add describeConfigs to KafkaAdminClient. Thanks @BenFradet! (#196)
• Change the default producer setting max.retries to 0. (#211)

Updates

• Update cats-effect to 2.0.0. Thanks @scala-steward! (#208)
• Update fs2 to 2.0.0. Thanks @scala-steward! (#209)
• Update kafka-avro-serializer to 5.3.1. Thanks @scala-steward! (#210)
• Update vulcan to 0.2.0. Thanks @scala-steward! (#207)

Documentation

• Add documentation for the KafkaAdminClient. Thanks @BenFradet! (#201)

Miscellaneous

• Update sbt to 1.3.0. Thanks @scala-steward! (#199)
• Update sbt-sonatype to 3.6. Thanks @scala-steward! (#204)
• Update scalatestplus-scalacheck to 3.1.0.0-RC2. Thanks @scala-steward! (#206)

Released on 2019-09-11.

fs2-kafka v0.20.0-RC1

Changes

• Add alterConfigs to KafkaAdminClient. Thanks @joceron! (#158)
• Add assignmentStream to KafkaConsumer. Thanks @danxmoran! (#169)
• Add Auth.Bearer for authentication token support in fs2-kafka-vulcan. (#176)
• Add createPartitions to KafkaAdminClient. Thanks @BenFradet! (#191)
• Add deleteTopic and deleteTopics to KafkaAdminClient. Thanks @BenFradet! (#192)
• Add Serializer.Record and Deserializer.Record for key/value-specific serializers. (#177)
• Add withGroupInstanceId to ConsumerSettings. (#178)
• Change to convert to Chunk in CommittableProducerRecords, ProducerRecords, and ProducerResult. Thanks @danxmoran! (#174, #187)
• Change to prioritize polls over other requests. (#180)
• Change to use TransactionalProducerSettings for TransactionalKafkaProducer. Thanks @danxmoran! (#186)
• Fix incorrect poll assertion potentially causing IllegalStateExceptions. Thanks @Fristi! (#194)
• Move isKey from AvroSettings to Serializer.Record and Deserializer.Record. (#177)

Updates

• Update cats to 2.0.0-RC2. (#195)
• Update cats-effect to 2.0.0-RC2. (#195)
• Update kafka-avro-serializer to 5.3.0. Thanks @scala-steward! (#163)
• Update vulcan to 0.2.0-RC2. Thanks @scala-steward! (#188)

Documentation

• Add documentation on how to share a schema registry client instance. (#179)
• Add more documentation on KafkaProducer#produce. Thanks @SystemFw! (#193)
• Add note on Confluent resolver. Thanks @mosman128 and @justinhj! (#159, #161)

Miscellaneous

• Update better-monadic-for to 0.3.1. Thanks @scala-steward! (#162)
• Update sbt-mdoc to 1.3.2. Thanks @scala-steward! (#185)
• Update sbt-mima-plugin to 0.6.0. Thanks @scala-steward! (#184)
• Update sbt-scalafmt to 2.0.4. Thanks @scala-steward! (#189)
• Update scalafmt to 2.0.1. Thanks @scala-steward! (#181)

Released on 2019-08-30.

fs2-kafka v0.20.0-M2

Changes

• Add fs2-kafka-vulcan for integration with vulcan. (#156)

Released on 2019-07-12.

fs2-kafka v0.20.0-M1

Overview

This release introduces several breaking changes to binary- and source-compatibility.
Note binary- and source-compatibility is not guaranteed between milestone releases.

Changes

• Add ConsumerSettings#withAllowAutoCreateTopics and withClientRack. (#153)
• Add producer with support for Kafka transactions. Thanks @danxmoran! (#128, #130, #144, #146)
• Add support for Scala 2.13. (#151, #154)
• Change Deserializer to support deserialization effects. (#120, #122, #131, #135)
  • Deserializer[A] is now Deserializer[F[_], A] with Sync[F].
  • ConsumerSettings[K, V] is now ConsumerSettings[F[_], K, V].
  • For Java Kafka Deserializer interoperability, refer to the documentation.
• Change KafkaAdminClient to use a blocking ExecutionContext. (#141)
  • Changed to Blocker as part of #150.
• Change Serializer to support serialization effects. (#118, #119, #122, #136)
  • Serializer[A] is now Serializer[F[_], A] with Sync[F].
  • ProducerSettings[K, V] is now ProducerSettings[F[_], K, V].
  • For Java Kafka Serializer interoperability, refer to the documentation.
• Change default auto.offset.reset to none in ConsumerSettings. (#121)
• Change to expose more Java Kafka type aliases. (#133)
• Change to parameterize AdminClientSettings on the effect type. (#125)
  • AdminClientSettings is now AdminClientSettings[F[_]] with Sync[F].
• Change to remove the concept of messages. (#144)
  • Rename ProducerMessage to ProducerRecords.
  • Rename CommittableMessage#committableOffset to offset.
  • Rename CommittableMessage to CommittableConsumerRecord.
• Change to simplify produce and commit with produce pipe. (#146)
  • Change KafkaProducer to no longer be sealed.
  • Remove KafkaProducer#producePassthrough.
  • Remove most batch commit pipes: commitBatch, commitBatchF, commitBatchOption, commitBatchOptionF, commitBatchChunk, commitBatchChunkF, commitBatchChunkOption, commitBatchChunkOptionF, commitBatchWithinF, and commitBatchOptionWithin, commitBatchOptionWithinF.
• Change to support creation effect for serializers. (#142)
• Change to use Blocker over ExecutionContext in settings. (#150)
  • ConsumerSettings#executionContext is now instead blocker.
  • ConsumerSettings#withExecutionContext is now withBlocker.
  • Similar changes to ProducerSettings and AdminClientSettings.
• Prevent mixing consumer group ids in the same CommittableOffsetBatch. (#148)
• Remove Header#headers. (#147)
• Remove functions for creating ExecutionContexts. (#145)
  • Removes the following functions: consumerExecutionContextResource, consumerExecutionContextStream, producerExecutionContextResource, producerExecutionContextStream, adminClientExecutionContextResource, and adminClientExecutionContextStream.
• Remove serialization support for org.apache.kafka.common.utils.Bytes. (#139)
• Remove the ProducerMessage[F].of syntax. (#134)
  • There is also no ProducerRecords[F].of after rename in #144.

Updates

• Update FS2 to 1.1.0-M1. (#149)
• Update Kafka to 2.3.0. (#153)

Documentation

• Add initial consumer documentation. (#138)
• Add initial producer documentation. (#152)
• Add initial transactions documentation. (#152)

Internals

• Change KafkaConsumerActor to not store records internally. (#129)
• Change to use internal WithConsumer construct. (#124)

Released on 2019-07-04.

fs2-kafka v0.19.9

Changes

• Change to handle commits during rebalancing. Thanks @CremboC! (#117)

Released on 2019-04-03.

fs2-kafka v0.19.8

Additions

• Add initial debug logging using SLF4J. Thanks @backuitist! (#108, #113)

Changes

• Change to only pause/resume partitions when necessary. (#112)
• Change to only start polling after streaming has started. Thanks @Krever! (#110, #114)
• Change to revoke previous duplicate fetch and issue warning log. Thanks @backuitist! (#107)
• Fix race condition which could cause duplicate records. (#111)

Released on 2019-04-02.