NOSNOW: improve troubleshooting experience for scenario with skipped offsets #883

sfc-gh-gjachimko · 2024-07-16T07:24:27Z

NOSNOW

Change the verbosity (of first log message occurrence) and message content to improve troubleshooting expience as requested by support team.

Pre-review checklist

sfc-gh-achyzy

I'm not sure I like the usage of different levels depending on the number of occurrences.

sfc-gh-achyzy · 2024-07-16T07:28:01Z

src/main/java/com/snowflake/kafka/connector/internal/streaming/DirectTopicPartitionChannel.java

@@ -323,14 +328,20 @@ public void insertRecord(SinkRecord kafkaSinkRecord, boolean isFirstRowPerPartit
    if (currentProcessedOffset == NO_OFFSET_TOKEN_REGISTERED_IN_SNOWFLAKE
        || kafkaSinkRecord.kafkaOffset() >= currentProcessedOffset + 1) {
      transformAndSend(kafkaSinkRecord);
+      isFirstMismatchedOffset.set(true);


I'm not a fan of logging something on the first occurrence and later skipping.
I propose to keep it consistent.

after discussions - changed to warn.

sfc-gh-achyzy · 2024-07-16T07:31:49Z

src/main/java/com/snowflake/kafka/connector/internal/streaming/DirectTopicPartitionChannel.java

+          isFirstMismatchedOffset.getAndSet(false) ? LOGGER::warn : LOGGER::debug;
+
+      logMsgDelegate.accept(
+          "Connector's channel {} expected record at offset {} but received {}. Offset stored in"


Suggested change

"Connector's channel {} expected record at offset {} but received {}. Offset stored in"

"Channel {} expected record at offset {} but received {}. The current offset stored in"

sfc-gh-hachouraria · 2024-07-17T02:41:18Z

...ain/java/com/snowflake/kafka/connector/internal/streaming/BufferedTopicPartitionChannel.java

-              + " offsetPersistedInSnowflake:{}, processedOffset:{}",
-          kafkaSinkRecord.kafkaOffset(),
+      LOGGER.warn(
+          "Channel {} expected record at offset {} but received {}. The current offset stored in"


Thank you very much for addressing this!

Could we keep the skip messaging too?

The new warn message is great, but it doesn't let the reader know what the connector's action was (skip) so they can mentally match it to their observed lag/loss situation.

ok, extended the message a bit.

…offsets

…offsets (snowflakedb#883) (cherry picked from commit 7172481)

* NOSNOW: added utility to upload connector to our nexus for simplified k8s deployment (snowflakedb#874) (cherry picked from commit ee83e22) * SNOW-1514185: Do assign the reopened channel unless kafka offsets are fully reset (snowflakedb#875) (cherry picked from commit 05dcbdf) * SNOW-1061851: Run SnowflakeSinkServiceV2IT for a single buffer (snowflakedb#876) (cherry picked from commit 7fce0f5) * SNOW-1061855 Fix the E2E test for SchemaEvolutionDropTable with a single buffer (snowflakedb#882) (cherry picked from commit fbd15d6) * NOSNOW: improve troubleshooting experience for scenario with skipped offsets (snowflakedb#883) (cherry picked from commit 7172481) * Adding logs to track schematization (snowflakedb#884) (cherry picked from commit 9905c7f) * Remove insertRows DEBUG log (called once per row) (snowflakedb#886) (cherry picked from commit 363457d) * NO-SNOW Upgrade nexus-staging-maven-plugin version (snowflakedb#887) (cherry picked from commit ac1276e) * Upgrade com.google.protobuf to 3.24.4 (snowflakedb#892) (cherry picked from commit 3c7e18c) * SNOW-1229110 Add single buffer usage data to telemetry (snowflakedb#893) (cherry picked from commit 96d3bfa) * SNOW-1541942 Extend Snowpipe initialization logging at INFO level (snowflakedb#885) (cherry picked from commit eab4c9c) * SNOW-947731 Remove deprecated avro-python3 package (snowflakedb#889) (cherry picked from commit 47624f5) * Bump dev.failsafe:failsafe from 3.2.1 to 3.3.2 (snowflakedb#859) Signed-off-by: dependabot[bot] <[email protected]> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Co-authored-by: Michał Bobowski <[email protected]> (cherry picked from commit 4a22f56) * Bump org.assertj:assertj-core from 3.25.3 to 3.26.3 (snowflakedb#881) Signed-off-by: dependabot[bot] <[email protected]> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Co-authored-by: Michał Bobowski <[email protected]> (cherry picked from commit adb896c) * Bump io.dropwizard.metrics:metrics-core from 4.2.3 to 4.2.26 (snowflakedb#863) Signed-off-by: dependabot[bot] <[email protected]> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Co-authored-by: Michał Bobowski <[email protected]> (cherry picked from commit 258ed2d) * NO-SNOW Ignore OAuth test (snowflakedb#906) (cherry picked from commit 30d2e8b) * SNOW-1229108 Add warning about buffer config when single buffer enabled (snowflakedb#896) (cherry picked from commit 9aa0b0b) * NO_SNOW Update dependencies (snowflakedb#898) Co-authored-by: Michał Bobowski <[email protected]> (cherry picked from commit eff23e2) * SNOW-1618257 - upgrade to 2.2.0 ingest-sdk (snowflakedb#910) (cherry picked from commit d0e97fb) * NO-SNOW Release v.2.4.0 (snowflakedb#907) Co-authored-by: Xin Huang <[email protected]> (cherry picked from commit 05c1148) --------- Co-authored-by: Greg Jachimko <[email protected]> Co-authored-by: Adrian Kowalczyk <[email protected]> Co-authored-by: Michał Bobowski <[email protected]> Co-authored-by: Xin Huang <[email protected]> Co-authored-by: Wojciech Trefon <[email protected]> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

…offsets (snowflakedb#883)

* SNOW-1269024 Installing multiple Java versions for test purposes (snowflakedb#824) Building and unit testing process remains the same (Java8) but e2e testing is run on three different versions of JAVA: 8, 11 and 17. This means that there are 3 times more testing jobs, but they all run in parallel, hence total run time should remain ~the same. * SNOW-1269025 Testing Confluent kafka connector using multiple JRE versions (snowflakedb#826) Building and unit testing process remains the same (Java8) but e2e testing is run on three different versions of JAVA: 8, 11 and 17. This means that there are 3 times more testing jobs, but they all run in parallel, hence total run time should remain ~the same. * SNOW-1269038 Stress testing Confluent kafka connector using multiple JRE versions (snowflakedb#827) Building and unit testing process remains the same (Java8) but stress testing is run on three different versions of JAVA: 8, 11 and 17. This means that there are 3 times more testing jobs, but they all run in parallel, hence total run time should remain ~the same. * SNOW-1348656 Migrate RecordContentTest to JUnit5 (snowflakedb#828) * SNOW-1056407 Cleanup metadata properties class. Migrate records tests to junit5 (snowflakedb#831) * NO-SNOW Fix build warnings by declaring maven-plugin versions (snowflakedb#837) * NO-SNOW Fix idempotent multiple column schema evolution (snowflakedb#836) * SNOW-1348656 Send records that could not be parsed to DLQ (snowflakedb#830) * SNOW-1056407 Add tests MetaColumnTest for snowpipe streaming (snowflakedb#832) * SNOW-1369271 Ignore SFException when closing a channel (snowflakedb#839) * NO-SNOW Remove unused code path from RecordService (snowflakedb#838) * SNOW-1056407 Add SnowflakeConnectorPushTime to metadata (snowflakedb#833) * Transfer ownership of project in CODEOWNERS file. Change streaming-ingest to snowpipe kafka team (snowflakedb#842) * SNOW-1369280 Close channels asynchronously (snowflakedb#841) * NO-SNOW Ugrade to ingest-sdk 2.1.1 (snowflakedb#843) * SNOW-1167007: Migrate schema when receiving null values for not null cols (snowflakedb#849) * SNOW-1061848: Introduce TopicPartitionChannel interface (snowflakedb#851) * SNOW-1061822: Add new properties for streaming client (snowflakedb#822) * change team name used in CODEOWNERS from @snowflakedb/snowpipe-pull-b… (snowflakedb#853) * SNOW-1061848: DirectTopicPartitionChannel - copy of the old implementation with removed buffer (snowflakedb#852) * SNOW-1061848: Fix unit tests (snowflakedb#855) * SGRC-4405 Update Kafka to 3.7.0 and Confluent to 7.6.0 (snowflakedb#854) * NO-SNOW Add dependabot (snowflakedb#856) * SNOW-1061848: Run TopicPartitionChannelIT against a non-buffered path (snowflakedb#862) * SNOW-1475664: Move additional error handling from BufferedTopicPartitionChannel to fix E2E test (snowflakedb#865) * NO_SNOW Add column comments from schemaregistry (snowflakedb#870) Co-authored-by: jaegwon.seo <[email protected]> * SNOW-1061854 Run e2e tests with single buffer (snowflakedb#867) * SNOW-1019628 Enable V2 file cleaner for Snowpipe ingestion by default (snowflakedb#868) * Release v2.3.0 (snowflakedb#873) * NOSNOW: added utility to upload connector to our nexus for simplified k8s deployment (snowflakedb#874) * SNOW-1514185: Do assign the reopened channel unless kafka offsets are fully reset (snowflakedb#875) * SNOW-1061851: Run SnowflakeSinkServiceV2IT for a single buffer (snowflakedb#876) * SNOW-1061855 Fix the E2E test for SchemaEvolutionDropTable with a single buffer (snowflakedb#882) * NOSNOW: improve troubleshooting experience for scenario with skipped offsets (snowflakedb#883) * Adding logs to track schematization (snowflakedb#884) * Remove insertRows DEBUG log (called once per row) (snowflakedb#886) * NO-SNOW Upgrade nexus-staging-maven-plugin version (snowflakedb#887) * Upgrade com.google.protobuf to 3.24.4 (snowflakedb#892) * SNOW-1229110 Add single buffer usage data to telemetry (snowflakedb#893) * SNOW-1541942 Extend Snowpipe initialization logging at INFO level (snowflakedb#885) * SNOW-947731 Remove deprecated avro-python3 package (snowflakedb#889) * Bump dev.failsafe:failsafe from 3.2.1 to 3.3.2 (snowflakedb#859) Signed-off-by: dependabot[bot] <[email protected]> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Co-authored-by: Michał Bobowski <[email protected]> * Bump org.assertj:assertj-core from 3.25.3 to 3.26.3 (snowflakedb#881) Signed-off-by: dependabot[bot] <[email protected]> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Co-authored-by: Michał Bobowski <[email protected]> * Bump io.dropwizard.metrics:metrics-core from 4.2.3 to 4.2.26 (snowflakedb#863) Signed-off-by: dependabot[bot] <[email protected]> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Co-authored-by: Michał Bobowski <[email protected]> * NO-SNOW Ignore OAuth test (snowflakedb#906) * SNOW-1229108 Add warning about buffer config when single buffer enabled (snowflakedb#896) * NO_SNOW Update dependencies (snowflakedb#898) Co-authored-by: Michał Bobowski <[email protected]> * SNOW-1618257 - upgrade to 2.2.0 ingest-sdk (snowflakedb#910) * NO-SNOW Release v.2.4.0 (snowflakedb#907) Co-authored-by: Xin Huang <[email protected]> * SNOW-1571459 parse jbdc properties (snowflakedb#909) * SNOW-1514185 Assign new channel when no offset is present in Snowflake (snowflakedb#913) * NO-SNOW Ignore major updates on Kafka dependencies (snowflakedb#915) * SNOW-1623269 Fail sink task on authorization exception from Snowflake (snowflakedb#916) * SNOW-1649161 Fix NaN value handling in schematization (snowflakedb#920) * NO-SNOW Release 2.4.1 (snowflakedb#923) * SNOW-1658905 Limit SnowflakeSinkConnectorConfig responsibilities (snowflakedb#925) * NO-SNOW Enable closing channels in parallel by default (snowflakedb#928) * SNOW-1658905 Create snowflake.streaming.iceberg.enabled parameter (snowflakedb#927) * Bump org.awaitility:awaitility from 4.0.0 to 4.2.2 (snowflakedb#911) Signed-off-by: dependabot[bot] <[email protected]> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Co-authored-by: Michał Bobowski <[email protected]> * NO-SNOW Enable single buffering in Snowpipe Streaming by default (snowflakedb#924) * SNOW-1658905 Integration tests setup for Iceberg (snowflakedb#930) * SNOW-1658905 Improve Iceberg table validations (snowflakedb#933) * SNOW-1658914: init record_meta column type (snowflakedb#934) * [Snyk] Fix for 2 vulnerabilities (snowflakedb#929) Co-authored-by: snyk-bot <[email protected]> Co-authored-by: Michał Bobowski <[email protected]> * SNOW-1658905 Do not run Iceberg tests outside of AWS (snowflakedb#935) * NO-SNOW: Insert row into iceberg table test (snowflakedb#938) * SNOW-1658905 Complete Iceberg validations (snowflakedb#937) * SNOW-1692725 Profiles to handle AWS specific tests (snowflakedb#939) * SNOW-1642799: added exception handler when moving invalid file to table stage; file cleaner will preserve 'dirty' files a bit longer (snowflakedb#931) * SNOW-1694636: Schematization utils refactor (PART 1) (snowflakedb#942) * SNOW-1694636: Schematization utils refactor (PART 3) - Refactor schema resolver (snowflakedb#944) * SNOW-1680410 adjust validations and create metadata column if not exists (snowflakedb#946) * SNOW-1686497 Remove single buffer warning for "buffer.size.bytes" (snowflakedb#950) * Updated avro (snowflakedb#956) fix snowflakedb#952 * SNOW-0000: extended telemetry with partitionId, fixed the event type sen… (snowflakedb#958) * [SNOW-1731570] upgrade to 2.3.0 ingest-sdk (snowflakedb#959) * SNOW-1665417 schema evolution primitives (snowflakedb#957) * SNOW-1728000 Remove clean flag from tests (snowflakedb#962) * SNOW-1692749: no schema evolution it + refactor (snowflakedb#960) * SNOW-1728000 TestExecutor and TestSelector for e2e tests (snowflakedb#963) * SNOW-1692749: Add assertions for records in table (snowflakedb#964) * SNOW-1728000 CloudPlatform enum and unused code removal in e2e tests (snowflakedb#967) * PROD-135021 Reduced stress tests matrix (snowflakedb#970) * SNOW-1278872 Added jdk version and vendor to metrics (snowflakedb#972) * SNOW-1728000 Cloud platform tests filtering (snowflakedb#968) * NO-SNOW Updated junit-bom to 5.11.2 (snowflakedb#974) * SNOW-1737840: Adapt record mapping in RecordService (snowflakedb#969) * Fix logging for closing partition channels - partition and topic misplaced (snowflakedb#977) * SNOW-1728000 Sample cloud specific e2e test (snowflakedb#973) Co-authored-by: Wojciech Trefon <[email protected]> * SNOW-1759821 - [GitHub] Too many Warnings: "might have an offset token mismatch based on the provided offset token verification logic" (snowflakedb#971) Co-authored-by: Michal Bobowski <[email protected]> * Revert "NO-SNOW Enable single buffering in Snowpipe Streaming by default (snowflakedb#924)" (snowflakedb#981) * NO-SNOW Release 2.5.0 (snowflakedb#975) * NO-SNOW Change kafka-connect-avro-converter scope to provided (snowflakedb#985) * NO-SNOW Remove FIPS test (snowflakedb#989) * NO-SNOW use com.fasterxml json (snowflakedb#994) * SNOW-1728002 get rid of reflection when enabling iceberg streaming (snowflakedb#995) Co-authored-by: Michal Bobowski <[email protected]> * SNOW-1665420 add logic to parse Iceberg schema (snowflakedb#996) * NO-SNOW Enable IcebergInitServiceIT (snowflakedb#1001) * SNOW-1728000 Iceberg e2e tests (snowflakedb#1002) * SNOW-1761519 Fix empty arrays in Iceberg ingestion (snowflakedb#1003) * [Snyk] Fix for 1 vulnerabilities (snowflakedb#1004) Co-authored-by: snyk-bot <[email protected]> Co-authored-by: Michal Bobowski <[email protected]> * NO_SNOW Update Snowflake JDBC to 3.20.0 (snowflakedb#1000) * SNOW-1805174 Enable single buffer by default (snowflakedb#1005) * Update ConnectorConfigDefinition.java (snowflakedb#1009) Co-authored-by: Sudesh Wasnik <[email protected]> * SNOW-1831140 Iceberg schema evolution e2e test setup (snowflakedb#1010) * NO-SNOW Fix missing ubuntu packages error in CI (snowflakedb#1011) * SNOW-1729292 modify iceberg tree based on record data (snowflakedb#1007) * SNOW-1831140 E2e tests of Iceberg JSON ingestion (snowflakedb#1013) * SNOW-1842220 Add comments to columns created by schema evolution (snowflakedb#1014) * SNOW-1831140 Complete Iceberg e2e tests (snowflakedb#1015) * NO-SNOW Update Confluent dependencies to 7.7.2 (snowflakedb#1019) * SNOW-1820302 Integrate with ingest sdk 3.0.1 (snowflakedb#1016) * NO-SNOW Update jackson and commons-compress (snowflakedb#1021) * SNOW-1731255: Put null or empty json nodes to DLQ for schema evolution (snowflakedb#1017) * NO-SNOW Release 3.0.0 (snowflakedb#1022) * NO-SNOW Improve offset logging for Snowpipe (snowflakedb#1027) Co-authored-by: Wojciech Trefon <[email protected]> * NO-SNOW speed up Iceberg schema evolution test (snowflakedb#1028) * SNOW-1826209 Update Confluent to 7.8.0 (snowflakedb#1029) * SNOW-1859651 Salt prefix for files mapped from different topics (snowflakedb#1035) Given two topics that are setup to be ingested to a single table using Snowpipe ingestion, each of the topics has an assigned cleaner for deleting already ingested files. This change prevents these cleaners from incorrectly cleaning files from the topic that should be handled by the other cleaner. Any topic that is mapped by the topic2table.map should have filename prefix salted with the topic as it is otherwise complicated (and unnecessary) to determine which other topic can have a clash on cleaning filenames. * SNOW-1875173: Support external OAuth (snowflakedb#1040) * [Snyk] Fix for 1 vulnerabilities (snowflakedb#1031) Co-authored-by: snyk-bot <[email protected]> Co-authored-by: Michal Bobowski <[email protected]> * SNOW-1880066: Update profile for azure and gcp (snowflakedb#1042) * Fix IndexOutOfBoundException thrown when offsets are not continous during schema-evolution (snowflakedb#1043) * NO-SNOW: Release 3.1.0 (snowflakedb#1044) * CONN-10472 Introducing StreamingSinkServiceBuilder (snowflakedb#1091) * SNOW-2034182 [Data loss fix] Change OnErrorOption from CONTINUE to SKIP_BATCH (snowflakedb#1092) * Fix IT's * set new features default to false * CC-33921: Add snowflake proxy server related changes to v3 Upgrade PR Branch (#114) * CC-33579: Expose connector level proxy configs in snowflake-kafka-connector (#109) * Add support for connector level HTTPS proxy configuration in Snowflake connector * review comments * use confluent ingest java in pom_confluent.xml * Add Snowflake ingest SDK to license processing * upse snowflake-jdbc version 3.23.0 * Add AWS CodeArtifact repository for Confluent packages * Remove redundant assertions for Snowflake proxy properties in SinkTaskProxyIT tests * ./format.sh with temurin jdk 11 * add disallow.local.ips config * bring in all configs * use constant * use new version with dns filtering * allow local ips * ingore connect-utils dependency * add back connector proxy related configs * formatting * ingest-sdk updates * catch and log error (related to #incident-2775) (#113) (#118) Co-authored-by: Sangeet Mishra <[email protected]> * Fix tests (#120) * CC-33579: Expose connector level proxy configs in snowflake-kafka-connector (#109) * Add support for connector level HTTPS proxy configuration in Snowflake connector * review comments * use confluent ingest java in pom_confluent.xml * Add Snowflake ingest SDK to license processing * upse snowflake-jdbc version 3.23.0 * Add AWS CodeArtifact repository for Confluent packages * Remove redundant assertions for Snowflake proxy properties in SinkTaskProxyIT tests * ./format.sh with temurin jdk 11 * catch and log error (related to #incident-2775) (#113) #inc-2775_lcc-8d018r-snowflake-sink-connector-failing-with-index-0-out-of-bo * Revert "CC-33579: Expose connector level proxy configs in snowflake-kafka-connector (#109)" (#115) This reverts commit a90160d. * Revert "Revert "CC-33579: Expose connector level proxy configs in snowflake-kafka-connector (#109)" (#115)" (#116) This reverts commit 59e7d79. * use httpclient 4 * fix tests * enable single buffer * disable single buffer and fix tests * fix testSkippingOffsetsInSchemaEvolution test --------- Co-authored-by: Sangeet Mishra <[email protected]> Co-authored-by: Yashi Srivastava <[email protected]> * fix dataloss in BufferedTopicPartitionChannel (#123) * Cherry pick latest 2.2.x commits (#124) * Change type from String to PASSWORD (#121) * CC-34826: APPSEC-5620: Add FilteringDNSResolver configs (#112) * add disallow.local.ips config * bring in all configs * use constant * use new version with dns filtering * update the ingest sdk correct version * allow local ips * fix configs * update ingest sdk to 2.0.3-1 with refactored changes * update ingest sdk to 2.0.4-1 with shade fix * update ingest sdk to 2.0.4-2 with shade fix * update ingest sdk to 2.0.4-3 with shade fix * ingore connect-utils dependency * use 2.1.5-2 of snowflake-ingest with dns filtering resolver * remove redundnat code * add connect-utils dependency * jdbc-upgrade (#117) * Disallow private IP checks on IT (#122) * remove extra line --------- Co-authored-by: Sudesh Wasnik <[email protected]> Co-authored-by: Sangeet Mishra <[email protected]> * add proxy properties in StreamingUtils (#125) --------- Co-authored-by: Nirut Gupta <[email protected]> Co-authored-by: Yashi Srivastava <[email protected]> Co-authored-by: Sudesh Wasnik <[email protected]> --------- Signed-off-by: dependabot[bot] <[email protected]> Co-authored-by: Kuba Rosiński <[email protected]> Co-authored-by: Michał Bobowski <[email protected]> Co-authored-by: Lex Shcharbaty <[email protected]> Co-authored-by: Xin Huang <[email protected]> Co-authored-by: Norbert Sienkiewicz <[email protected]> Co-authored-by: Wojciech Trefon <[email protected]> Co-authored-by: Adrian Kowalczyk <[email protected]> Co-authored-by: jaegwon.seo <[email protected]> Co-authored-by: Greg Jachimko <[email protected]> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Co-authored-by: Michał Bobowski <[email protected]> Co-authored-by: Bartłomiej Ząbek <[email protected]> Co-authored-by: sfc-gh-snowflakedb-snyk-sa <[email protected]> Co-authored-by: snyk-bot <[email protected]> Co-authored-by: Marcel Jedig <[email protected]> Co-authored-by: Artur Chyży <[email protected]> Co-authored-by: Robert Sawicki <[email protected]> Co-authored-by: Sudesh Wasnik <[email protected]> Co-authored-by: Dariusz Seweryn <[email protected]> Co-authored-by: Sangeet Mishra <[email protected]> Co-authored-by: Yashi Srivastava <[email protected]>

sfc-gh-gjachimko requested a review from a team as a code owner July 16, 2024 07:24

sfc-gh-achyzy reviewed Jul 16, 2024

View reviewed changes

sfc-gh-hachouraria reviewed Jul 17, 2024

View reviewed changes

NOSNOW: improve troubleshooting experience for scenario with skipped …

829d568

…offsets

sfc-gh-gjachimko force-pushed the gjachimko/NOSNOW-improve_skip_offset_logging branch from 0de3fad to 829d568 Compare July 18, 2024 06:20

sfc-gh-lshcharbaty approved these changes Jul 18, 2024

View reviewed changes

sfc-gh-gjachimko merged commit 7172481 into master Jul 18, 2024

sfc-gh-gjachimko deleted the gjachimko/NOSNOW-improve_skip_offset_logging branch July 18, 2024 08:46

airlock-confluentinc bot pushed a commit to confluentinc/snowflake-kafka-connector that referenced this pull request Aug 22, 2024

NOSNOW: improve troubleshooting experience for scenario with skipped …

0dc8ca0

…offsets (snowflakedb#883) (cherry picked from commit 7172481)

airlock-confluentinc bot pushed a commit to confluentinc/snowflake-kafka-connector that referenced this pull request Mar 4, 2025

NOSNOW: improve troubleshooting experience for scenario with skipped …

18ffb52

…offsets (snowflakedb#883)

airlock-confluentinc bot pushed a commit to confluentinc/snowflake-kafka-connector that referenced this pull request May 29, 2025

NOSNOW: improve troubleshooting experience for scenario with skipped …

8d67c09

…offsets (snowflakedb#883)

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

NOSNOW: improve troubleshooting experience for scenario with skipped offsets #883

NOSNOW: improve troubleshooting experience for scenario with skipped offsets #883

Uh oh!

sfc-gh-gjachimko commented Jul 16, 2024

Uh oh!

sfc-gh-achyzy left a comment

Uh oh!

sfc-gh-achyzy Jul 16, 2024

Uh oh!

sfc-gh-gjachimko Jul 16, 2024 •

edited

Loading

Uh oh!

sfc-gh-achyzy Jul 16, 2024

Uh oh!

sfc-gh-hachouraria Jul 17, 2024 •

edited

Loading

Uh oh!

sfc-gh-gjachimko Jul 17, 2024

Uh oh!

Uh oh!

	"Connector's channel {} expected record at offset {} but received {}. Offset stored in"
	"Channel {} expected record at offset {} but received {}. The current offset stored in"

NOSNOW: improve troubleshooting experience for scenario with skipped offsets #883

NOSNOW: improve troubleshooting experience for scenario with skipped offsets #883

Uh oh!

Conversation

sfc-gh-gjachimko commented Jul 16, 2024

Pre-review checklist

Uh oh!

sfc-gh-achyzy left a comment

Choose a reason for hiding this comment

Uh oh!

sfc-gh-achyzy Jul 16, 2024

Choose a reason for hiding this comment

Uh oh!

sfc-gh-gjachimko Jul 16, 2024 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Choose a reason for hiding this comment

Uh oh!

sfc-gh-achyzy Jul 16, 2024

Choose a reason for hiding this comment

Uh oh!

sfc-gh-hachouraria Jul 17, 2024 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Choose a reason for hiding this comment

Uh oh!

sfc-gh-gjachimko Jul 17, 2024

Choose a reason for hiding this comment

Uh oh!

Uh oh!

sfc-gh-gjachimko Jul 16, 2024 •

edited

Loading

sfc-gh-hachouraria Jul 17, 2024 •

edited

Loading