Releases: snowflakedb/snowflake-kafka-connector
Releases · snowflakedb/snowflake-kafka-connector
v3.5.3
What's Changed
- NO-SNOW Adding jEnv file by @sfc-gh-lkucharski in #1254
- FLOW-8215 Performance issue in ConnectSchema.schemaType calls by @sfc-gh-lkucharski in #1252
- NO-SNOW Release 3.5.3 by @sfc-gh-skurella in #1259
New Contributors
- @sfc-gh-skurella made their first contribution in #1259
Full Changelog: v3.5.2...v3.5.3
v4.0.0-rc7
What's Changed
- FLOW-7864 Adapt iceberg tests for SSV2 by @sfc-gh-lkucharski in #1255
- SNOW-2995814 - Fix invalid streaming state by @sfc-gh-lkucharski in #1256
- Full Changelog: v4.0.0-rc6...4.0.0-rc7
v4.0.0-rc6
Notable changes
Destination tables are created if they do not exist. They have ENABLE_SCHEMA_EVOLUTION = true parameter set by default. Schema evolution is now officially supported.
What's Changed
- FLOW-7873 Autocreate table by @sfc-gh-lkucharski in #1241
- FLOW-7882 Adapt FDN schema evolution tests to the implementation from SSV2 server side by @sfc-gh-lkucharski in #1243
Full Changelog: v4.0.0-rc5...4.0.0-rc6
v3.5.2
What's Changed
- FLOW-8086 Release version 3.5.2 with CVE-2025-58056 and CVE-2025-58057 vulnerabilities fix for Netty by @sfc-gh-lkucharski in #1249
Full Changelog: v3.5.1...3.5.2
v3.5.1
What's Changed
- SNOW-2924265 Fix NullPointerException in SnowflakeSinkTask#precommit() by @sfc-gh-lkucharski in #1246
- FLOW-8012 Update snowflake-ingest-sdk to 4.4.1 by @sfc-gh-mbobowski in #1244
Full Changelog: v3.5.0...v3.5.1
v4.0.0-rc5
What's Changed
- NO-SNOW Add fallback delay by @sfc-gh-mbobowski in #1234
- FLOW-6875 Add TELEMETRY events for ssv2 service by @sfc-gh-lkucharski in #1236
- FLOW-7097 Fix protobuf tests by @sfc-gh-lkucharski in #1237
- FLOW-7792 React to error deltas instead of error absolute value by @sfc-gh-lkucharski in #1240
- NO-SNOW Release 4.0.0-rc5 by @sfc-gh-lkucharski in #1242
Full Changelog: v4.0.0-rc4...v4.0.0-rc5
v3.5.0
What's Changed
- SNOW-2464956 Recreate closed streaming ingest client by @sfc-gh-aminyaylov in #1197
- SNOW-2464956: Upgrade ingest SDK to 4.4.0 by @sfc-gh-aminyaylov in #1220
- SNOW-2860998 Schema evolution granular logging by @sfc-gh-mbobowski in #1222
- CONN-10511 Automatic failover for Snowpipe Streaming by @sfc-gh-mbobowski in #1238
Full Changelog: v3.4.0...3.5.0
v4.0.0-rc4
Notable changes
- The destination table information is now cached for 5 minutes by default. If you're prototyping or testing, make sure to turn the cache off. See the documentation for more information
- Ingestion errors on Snowpipe Streaming channels are now monitored. The connector will fail the task if channel errors are detected.
Bugfixes
- Connector no longer fails when an encrypted private key is used to connect to Snowflake.
What's Changed
- FLOW-7323 Decrypt private key before sending it to SSV2 SDK by @sfc-gh-lkucharski in #1225
- FLOW-7368 Delete dead code + refactor by @sfc-gh-lkucharski in #1226
- FLOW-7380 Remove dependency on snowflake-ingest-sdk (ssv1) java library by @sfc-gh-lkucharski in #1227
- FLOW-7392 Remove schematization.enabled parameter by @sfc-gh-lkucharski in #1229
- FLOW-7496 Remove code related to schema evolution and schema validation by @sfc-gh-lkucharski in #1233
- FLOW-7464 Direct mapping from SinkRecord to Map by @sfc-gh-lkucharski in #1231
- FLOW-7155 Adapt iceberg tests for ssv2 by @sfc-gh-lkucharski in #1230
- FLOW-7395 React to channel error count by @sfc-gh-lkucharski in #1232
- NO-SNOW Release 4.0.0-rc4 by @sfc-gh-lkucharski in #1235
Full Changelog: v4.0.0-rc3...asdf
v4.0.0-rc3
Migration
- Migration from 4.0.0-rc2 is supported. No changes required.
- Migration from 4.0.0-rc1 is not supported.
- Migration from versions 3.x and 2.x is not supported
What's Changed
- FLOW-7174 Cache added for calls that are checking if the pipe and table exists in the database by @sfc-gh-lkucharski in #1218
- FLOW-7323 - Pass private key password to ingestion client by @sfc-gh-lkucharski in #1223
- NO-SNOW Release 4.0.0-rc3 by @sfc-gh-lkucharski in #1224
v4.0.0-rc2
Breaking Changes
- The class name of the main connector class has been changed from
snowflake.kafka.connector.SnowflakeSinkConnectortocom.snowflake.kafka.connector.SnowflakeStreamingSinkConnector snowflake.role.nameconfiguration parameter is no longer optional- SNOWPIPE channel naming convention has changed; the connector name is now prefixed to the name to prevent name collisions
- RECORD_CONTENT umbrella column used by the connector when schematization was disabled is not supported; SMT transformation can be used to achieve the same result
- Schematization is now enabled and can't be turned off. The first-level fields from the message content are now mapped to the column names
Warning
The configuration settings from version 4.0.0-rc1 will not work with this release. We do not recommend migrating the connectors running earlier versions to this release. Instead, create the new connectors and start over the ingestion pipelines.
What's Changed
- FLOW-6671 Bump snowpipe streaming sdk to 1.0.2 by @sfc-gh-lkucharski in #1201
- FLOW-6519 Rename com.snowflake.kafka.connector.SnowflakeSinkConnector to com.snowflake.kafka.connector.SnowflakeStreamingSinkConnector by @sfc-gh-lkucharski in #1199
- FLOW-6852 Propagate ROLE configuration parameter to snowpipe-streaming SDK client, make role mandatory config parameter by @sfc-gh-lkucharski in #1205
- FLOW-6203 Remove ssv1 and snowpipe code, rewrite tests by @sfc-gh-lkucharski in #1200
- FLOW-6862 Fix closeAll bug in the KC SSV2 sink service implementation by @sfc-gh-lkucharski in #1211
- FLOW-6876 Add connector name to channel name by @sfc-gh-lkucharski in #1210
- SNOW-6691 Use default pipe by @sfc-gh-lkucharski in #1204
- FLOW-7020 Upgrade snowpipe-streaming-sdk to 1.1.0 and enable tests for AZURE and GCP by @sfc-gh-lkucharski in #1214
- FLOW-6883 Flatten records from 1st level by @sfc-gh-lkucharski in #1213
- SNOW-2408336 Allow dots and hyphens in oauth url (#1186) by @sfc-gh-lkucharski in #1215
- FLOW-6874 Change "Install new version ..." message at startup (#1207) by @sfc-gh-lkucharski in #1216
Full Changelog: v4.0.0-rc1...4.0.0-rc2