v4.0.0-rc2
Breaking Changes
- The class name of the main connector class has been changed from
snowflake.kafka.connector.SnowflakeSinkConnectortocom.snowflake.kafka.connector.SnowflakeStreamingSinkConnector snowflake.role.nameconfiguration parameter is no longer optional- SNOWPIPE channel naming convention has changed; the connector name is now prefixed to the name to prevent name collisions
- RECORD_CONTENT umbrella column used by the connector when schematization was disabled is not supported; SMT transformation can be used to achieve the same result
- Schematization is now enabled and can't be turned off. The first-level fields from the message content are now mapped to the column names
Warning
The configuration settings from version 4.0.0-rc1 will not work with this release. We do not recommend migrating the connectors running earlier versions to this release. Instead, create the new connectors and start over the ingestion pipelines.
What's Changed
- FLOW-6671 Bump snowpipe streaming sdk to 1.0.2 by @sfc-gh-lkucharski in #1201
- FLOW-6519 Rename com.snowflake.kafka.connector.SnowflakeSinkConnector to com.snowflake.kafka.connector.SnowflakeStreamingSinkConnector by @sfc-gh-lkucharski in #1199
- FLOW-6852 Propagate ROLE configuration parameter to snowpipe-streaming SDK client, make role mandatory config parameter by @sfc-gh-lkucharski in #1205
- FLOW-6203 Remove ssv1 and snowpipe code, rewrite tests by @sfc-gh-lkucharski in #1200
- FLOW-6862 Fix closeAll bug in the KC SSV2 sink service implementation by @sfc-gh-lkucharski in #1211
- FLOW-6876 Add connector name to channel name by @sfc-gh-lkucharski in #1210
- SNOW-6691 Use default pipe by @sfc-gh-lkucharski in #1204
- FLOW-7020 Upgrade snowpipe-streaming-sdk to 1.1.0 and enable tests for AZURE and GCP by @sfc-gh-lkucharski in #1214
- FLOW-6883 Flatten records from 1st level by @sfc-gh-lkucharski in #1213
- SNOW-2408336 Allow dots and hyphens in oauth url (#1186) by @sfc-gh-lkucharski in #1215
- FLOW-6874 Change "Install new version ..." message at startup (#1207) by @sfc-gh-lkucharski in #1216
Full Changelog: v4.0.0-rc1...4.0.0-rc2