Skip to content

Conversation

@rodas96
Copy link

@rodas96 rodas96 commented Dec 9, 2025

Summary

Adds graceful handling of InfluxDB retention policy violations (HTTP 422 errors) to prevent pipeline crashes when writing data outside the configured retention period. And fixes timestamps len

Changes

  • ✅ Added raise_on_retention_violation parameter (default: False) for optional strict mode
  • ✅ HTTP 422 errors with "retention policy" message are logged as warnings and skipped by default
  • ✅ Kafka offsets are committed, preventing infinite retry loops
  • ✅ Other 422 errors (schema conflicts, etc.) still raise exceptions
  • ✅ Added comprehensive test coverage for both default and strict modes
  • ✅ Updated documentation
  • ✅ Fixed timestamp lens

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant