Releases: fd4s/fs2-kafka
fs2-kafka v3.6.0
It's been a while since v3.6.0-RC1 was released for the community to test and I think we're in a safe position for a new release 🚀
Most of the changes included here are dependency updates but the most important feature is the changes around KafkaProducer
fail-fast scenarios (thanks @rodrigo-molina for your contribution! 🎉) and the bump of Scala versions.
What's Changed
- Update sbt-typelevel, sbt-typelevel-site to 0.7.0 in series/3.x by @scala-steward in #1320
- Update kafka-avro-serializer to 7.6.1 in series/3.x by @scala-steward in #1319
- Update scala-library to 2.13.14 in series/3.x by @scala-steward in #1324
- Update sbt-typelevel, sbt-typelevel-site to 0.7.1 in series/3.x by @scala-steward in #1327
- Update sbt to 1.10.0 in series/3.x by @scala-steward in #1326
- Update discipline-scalatest to 2.3.0 in series/3.x by @scala-steward in #1329
- Update testcontainers-scala-kafka, ... to 0.41.4 in series/3.x by @scala-steward in #1331
- Update scalafmt-core to 3.8.2 in series/3.x by @scala-steward in #1332
- Update sbt to 1.10.1 in series/3.x by @scala-steward in #1335
- Update kafka-clients to 3.7.1 in series/3.x by @scala-steward in #1334
- Update vulcan to 1.11.0 in series/3.x by @scala-steward in #1333
- Update kafka-avro-serializer to 7.6.2 in series/3.x by @scala-steward in #1336
- Update kafka-clients to 3.8.0 in series/3.x by @scala-steward in #1337
- Update scalafmt-core to 3.8.3 in series/3.x by @scala-steward in #1338
- Update sbt-typelevel, sbt-typelevel-site to 0.7.2 in series/3.x by @scala-steward in #1339
- Update fs2-core to 3.11.0 in series/3.x by @scala-steward in #1345
- Update kafka-avro-serializer to 7.7.0 in series/3.x by @scala-steward in #1342
- Update sbt-typelevel, sbt-typelevel-site to 0.7.3 in series/3.x by @scala-steward in #1347
- Update scala3-library to 3.3.4 in series/3.x by @scala-steward in #1350
- Update scala-library to 2.13.15 in series/3.x by @scala-steward in #1349
- Update sbt to 1.10.2 in series/3.x by @scala-steward in #1351
- Update kafka-avro-serializer to 7.7.1 in series/3.x by @scala-steward in #1348
- KafkaProducer.produce fails fast by @rodrigo-molina in #1340
- Fix compilation after #1340 merge by @aartigao in #1353
- Update scala-library to 2.12.20 in series/3.x by @scala-steward in #1346
- Update sbt-typelevel, sbt-typelevel-site to 0.7.4 in series/3.x by @scala-steward in #1354
- Update vulcan to 1.11.1 in series/3.x by @scala-steward in #1355
- Update sbt, scripted-plugin to 1.10.4 in series/3.x by @scala-steward in #1356
- Update cats-effect, cats-effect-laws, ... to 3.5.5 in series/3.x by @scala-steward in #1357
- Update sbt-buildinfo to 0.13.1 in series/3.x by @scala-steward in #1358
- Update kafka-clients to 3.8.1 in series/3.x by @scala-steward in #1359
- Update sbt, scripted-plugin to 1.10.5 in series/3.x by @scala-steward in #1360
New Contributors
- @rodrigo-molina made their first contribution in #1340
Full Changelog: v3.5.1...v3.6.0
fs2-kafka v3.6.0-RC1
This pre-release is done mainly to test changes around KafkaProducer
fail-fast but also includes the bump of Scala versions.
What's Changed
- Update sbt-typelevel, sbt-typelevel-site to 0.7.0 in series/3.x by @scala-steward in #1320
- Update kafka-avro-serializer to 7.6.1 in series/3.x by @scala-steward in #1319
- Update scala-library to 2.13.14 in series/3.x by @scala-steward in #1324
- Update sbt-typelevel, sbt-typelevel-site to 0.7.1 in series/3.x by @scala-steward in #1327
- Update sbt to 1.10.0 in series/3.x by @scala-steward in #1326
- Update discipline-scalatest to 2.3.0 in series/3.x by @scala-steward in #1329
- Update testcontainers-scala-kafka, ... to 0.41.4 in series/3.x by @scala-steward in #1331
- Update scalafmt-core to 3.8.2 in series/3.x by @scala-steward in #1332
- Update sbt to 1.10.1 in series/3.x by @scala-steward in #1335
- Update kafka-clients to 3.7.1 in series/3.x by @scala-steward in #1334
- Update vulcan to 1.11.0 in series/3.x by @scala-steward in #1333
- Update kafka-avro-serializer to 7.6.2 in series/3.x by @scala-steward in #1336
- Update kafka-clients to 3.8.0 in series/3.x by @scala-steward in #1337
- Update scalafmt-core to 3.8.3 in series/3.x by @scala-steward in #1338
- Update sbt-typelevel, sbt-typelevel-site to 0.7.2 in series/3.x by @scala-steward in #1339
- Update fs2-core to 3.11.0 in series/3.x by @scala-steward in #1345
- Update kafka-avro-serializer to 7.7.0 in series/3.x by @scala-steward in #1342
- Update sbt-typelevel, sbt-typelevel-site to 0.7.3 in series/3.x by @scala-steward in #1347
- Update scala3-library to 3.3.4 in series/3.x by @scala-steward in #1350
- Update scala-library to 2.13.15 in series/3.x by @scala-steward in #1349
- Update sbt to 1.10.2 in series/3.x by @scala-steward in #1351
- Update kafka-avro-serializer to 7.7.1 in series/3.x by @scala-steward in #1348
- KafkaProducer.produce fails fast by @rodrigo-molina in #1340
- Fix compilation after #1340 merge by @aartigao in #1353
- Update scala-library to 2.12.20 in series/3.x by @scala-steward in #1346
New Contributors
- @rodrigo-molina made their first contribution in #1340
Full Changelog: v3.5.1...v3.6.0-RC1
fs2-kafka v3.5.1
Important Notice: Producer performance regression fixed ⚠️
Changes introduced in #1126 cause a significant performance drop in Producer (you can find more details with some nice graphs in #1321).
Users are encouraged to use v3.5.1 and avoid v3.5.0 for this reason.
Many thanks to @atnoya for noticing and seeking the root cause 🎉 (and mention to @abestel for confirming he was experiencing the same issues).
What's Changed
- Update
tlBaseVersion
to match latest tag by @aartigao in #1323 - Revert #1126 as it's causing a performance regression by @atnoya in #1322
New Contributors
Full Changelog: v3.5.0...v3.5.1
fs2-kafka v3.5.0
Important Notice: Memory leak found 🐛
A leak in the fetch loop caused by a misuse of the CE Fiber API has been found and fixed (more info in #1318). Of course, all users are encouraged to upgrade ⬆️
All credits to @abestel who took the time to investigate the root cause a propose a fix for it! 🙇🏽 🥇 Awesome contribution! 🎉
Depending on the usage, the leak advances slowly or faster. As an example, here's the graph of one of our services for the last 12h in Staging (with the SNAPSHOT that includes #1318) and Prod (with v3.4.0) (both envs share exactly the same load) 👇🏽
Staging
Prod
Relevant Changes
Other Changes
- Update
tlBaseVersion
to match latest tag by @aartigao in #1313 - Update fs2-core to 3.10.0 in series/3.x by @scala-steward in #1314
- Update sbt-buildinfo to 0.12.0 in series/3.x by @scala-steward in #1315
- Retry
RebalanceInProgressException
inCommitRecovery.Default
by @aartigao in #1312 - Change
Blocking
to useSync#interruptible
, notblocking
by @bastewart in #1126 - Update scalafmt-core to 3.8.1 in series/3.x by @scala-steward in #1317
- Update fs2-core to 3.10.2 in series/3.x by @scala-steward in #1316
Full Changelog: v3.4.0...v3.5.0
fs2-kafka v3.4.0
This release contains mostly version bumps for the library dependencies, but some of them are important enough to create a minor version 👇🏽
Relevant changes
- Latest Scala libs for 2.12, 2.13 and 3.3
- Latest Kafka Clients 3.7.x lineage (updated from 3.6.x in previous versions)
- Latest Kafka Avro Serializer 7.6.x lineage (updated from 7.5.x in previous versions)
What's Changed
- Add
aartigao
to developers list by @aartigao in #1298 - Plugin dependencies under
sbt-typelevel
umbrella by @aartigao in #1297 - Update testcontainers-scala-kafka, ... to 0.41.3 in series/3.x by @scala-steward in #1299
- Update kafka-avro-serializer to 7.6.0 in series/3.x by @scala-steward in #1300
- Update scalafmt-core to 3.8.0 in series/3.x by @scala-steward in #1301
- Update sbt-typelevel, sbt-typelevel-site to 0.6.6 in series/3.x by @scala-steward in #1302
- Improve
NotSubscribedException
message by @aartigao in #1303 - Update sbt-typelevel, sbt-typelevel-site to 0.6.7 in series/3.x by @scala-steward in #1311
- Update kind-projector to 0.13.3 in series/3.x by @scala-steward in #1310
- Update kafka-clients to 3.7.0 in series/3.x by @scala-steward in #1304
- Update sbt to 1.9.9 in series/3.x by @scala-steward in #1308
- Update cats-effect, cats-effect-laws, ... to 3.5.4 in series/3.x by @scala-steward in #1309
- Update scala-library to 2.12.19 in series/3.x by @scala-steward in #1305
- Update scala-library to 2.13.13 in series/3.x by @scala-steward in #1306
- Update scala3-library to 3.3.3 in series/3.x by @scala-steward in #1307
Full Changelog: v3.3.1...v3.4.0
fs2-kafka v3.3.1
Important Notice: Binary Incompatibilities ⚠️
This release fixes v3.3.0 by bringing back the binary incompatible changes.
Users are encouraged to use v3.3.1 and avoid v3.3.0 for this reason.
What's Changed
Full Changelog: v3.3.0...v3.3.1
fs2-kafka v3.3.0
This is the fifth stable fs2-kafka release to be based on the 3.x series of the Apache Kafka client library. It is available for Scala 2.12, 2.13, and 3.3; all users are encouraged to upgrade.
Thanks for the effort of the new contributors @cwholmes and @L7R7 🎉 We hope to see more nice contributions in the future! 💪🏽 🙌🏽
Important Notice: Binary Incompatibilities ⚠️
This release introduced binary incompatibilities in #1268. Users are encouraged to use v.3.3.1 instead 🙏🏽
Relevant Changes
- Support consumer offsets for times and list topics by @cwholmes
- Add chunk-based consumer API by @L7R7
What's Changed
- Use
Stream.iterable
instead ofStream.emits
by @aartigao in #1266 - Scalafmt update and Scala 3 syntax (
-Xsource:3
) by @aartigao in #1267 - Fix typos by @aartigao in #1269
- Update sbt to 1.9.7 in series/3.x by @scala-steward in #1271
- Update sbt-mdoc to 2.4.0 in series/3.x by @scala-steward in #1272
- Remove deprecated methods by @aartigao in #1268
- Update sbt-typelevel to 0.6.1 in series/3.x by @scala-steward in #1273
- Fix flaky
KafkaConsumer#assignmentStream
tests by @aartigao in #1274 - Update fs2-core to 3.9.3 in series/3.x by @scala-steward in #1275
- Update kafka-avro-serializer to 7.5.2 in series/3.x by @scala-steward in #1276
- Update sbt-mdoc to 2.5.1 in series/3.x by @scala-steward in #1277
- Revert "Update sbt-mdoc to 2.5.1 in series/3.x" by @aartigao in #1284
- Update scalafmt-core to 3.7.17 in series/3.x by @scala-steward in #1278
- Update logback-classic to 1.3.14 in series/3.x by @scala-steward in #1282
- Update sbt-typelevel to 0.6.3 in series/3.x by @scala-steward in #1283
- Update sbt-typelevel to 0.6.5 in series/3.x by @scala-steward in #1291
- Update vulcan to 1.10.1 in series/3.x by @scala-steward in #1286
- Update kafka-avro-serializer to 7.5.3 in series/3.x by @scala-steward in #1287
- Update kafka-clients to 3.6.1 in series/3.x by @scala-steward in #1288
- Update sbt to 1.9.8 in series/3.x by @scala-steward in #1289
- Support consumer offsets for times and list topics by @cwholmes in #1285
- Update cats-effect, cats-effect-laws, ... to 3.5.3 in series/3.x by @scala-steward in #1295
- Update fs2-core to 3.9.4 in series/3.x by @scala-steward in #1294
- Add chunk-based consumer API by @L7R7 in #1281
New Contributors
Full Changelog: v3.2.0...v3.3.0
fs2-kafka v3.2.0
This is the fourth stable fs2-kafka release to be based on the 3.x series of the Apache Kafka client library. It is available for Scala 2.12, 2.13, and 3.3; all users are encouraged to upgrade.
Relevant Changes
- Latest Scala libs for 2.12 and 2.13
- Latest Kafka Clients 3.6.x lineage (updated from 3.5.x in previous versions)
- MUnit Vulcan integration improvements by @keirlawson
What's Changed
- Update sbt-header to 5.10.0 in series/3.x by @scala-steward in #1258
- Update scala-library to 2.13.12 in series/3.x by @scala-steward in #1260
- Update scala-library to 2.12.18 in series/3.x by @scala-steward in #1259
- Expose creation of compat checker by @keirlawson in #988
- Fix CI build issues by @aartigao in #1261
- Update sbt-typelevel to 0.5.4 in series/3.x by @scala-steward in #1265
- Update sbt-mdoc to 2.3.8 in series/3.x by @scala-steward in #1264
- Update kafka-avro-serializer to 7.5.1 in series/3.x by @scala-steward in #1262
- Add compatiblity assertions with clues by @keirlawson in #990
- Update kafka-clients to 3.6.0 in series/3.x by @scala-steward in #1263
Full Changelog: v3.1.0...v3.2.0
fs2-kafka v3.1.0
This is the third stable fs2-kafka release to be based on the 3.x series of the Apache Kafka client library. It is available for Scala 2.12, 2.13, and 3.3; all users are encouraged to upgrade.
Development of the 2.x series is now discontinued. All new pull requests should target the 3.x branch.
This release bumps all third party dependencies to latest effective version (targeting JDK 8 as the base), fixes some transitive vulnerabilities and consolidates the build for Cats Effect 3.5.x and fs2 3.9.x.
Thanks everyone involved in the release and congrats to first-time contributors! 🥳 We hope to see more of your nice PRs in the near future! 💪🏽
What's Changed
- Remove VerifiableProperties issue workaround by @peter-hazell in #1231
- Update sbt to 1.8.3 in series/3.x by @scala-steward in #1204
- Update sbt-mima-plugin to 1.1.3 in series/3.x by @scala-steward in #1229
- Update kafka-clients to 3.4.1 in series/3.x by @scala-steward in #1214
- Update kafka-avro-serializer to 7.3.4 in series/3.x by @scala-steward in #1225
- SBT 1.9.x by @aartigao in #1245
- Bump CE and fs2 to the latest version by @aartigao in #1246
- Retire FakeFiber by @biochimia in #1238
- Mark
series/2.x
as EOL by @aartigao in #1248 - Update sbt-typelevel to 0.5.3 in series/3.x by @aartigao in #1247
- Updated transaction docs by @DanyYanev in #1201
- Make instantiation of CommitTimeoutException lazy. by @optician in #1150
- Added docs for graceful shutdown for cats-effect 3 by @LMnet in #1009
- Update kafka-avro-serializer to 7.4.0 in series/3.x by @scala-steward in #1203
- scala-steward (3.x series): reenable ignored 2.x series dependencies by @aartigao in #1249
- Bump third party deps by @aartigao in #1250
- Prepare release 3.1.0 by @aartigao in #1251
- Fix docs publishing by @aartigao in #1252
New Contributors
- @peter-hazell made their first contribution in #1231
- @aartigao made their first contribution in #1245
- @DanyYanev made their first contribution in #1201
- @optician made their first contribution in #1150
Full Changelog: v3.0.1...v3.1.0
fs2-kafka v3.0.1
This release makes some internal changes in preparation for changes to cancelation semantics forthcoming in cats-effect 3.5.0; it also updates some dependencies.
What's Changed
- Revert "Change to publish on series branches" by @bplommer in #1176
- Update sbt-mima-plugin to 1.1.2 in series/3.x by @scala-steward in #1184
- Post-3.0 release build updates by @bplommer in #1188
- Update sbt-typelevel to 0.4.20 in series/3.x by @scala-steward in #1192
- Update tlBaseVersion by @bplommer in #1197
- Preparatory changes for new CE cancelation semantics by @bplommer in #1187
- Update cats-effect, cats-effect-laws, ... to 3.4.9 in series/2.x by @scala-steward in #1195
- Update testcontainers-scala-kafka, ... to 0.40.15 in series/2.x by @scala-steward in #1194
- Update sbt-mima-plugin to 1.1.2 in series/2.x by @scala-steward in #1189
- Update logback-classic to 1.3.7 in series/2.x by @scala-steward in #1193
- Update scalafmt-core to 2.2.2 in series/2.x by @scala-steward in #1191
- Update kafka-avro-serializer to 6.2.10 in series/2.x by @scala-steward in #1190
- Update sbt-typelevel to 0.4.20 in series/2.x by @scala-steward in #1196
- Merge 2.x into 3.x by @bplommer in #1198
Full Changelog: v3.0.0...v3.0.1