Skip to content

Introduce a set of end-to-end Kafka integration use cases and troubleshoot guide #147

@gayaldassanayake

Description

@gayaldassanayake

$ subject.

Use cases

Twitter filter

assignee: @gayaldassanayake

A filtering application that consumes a stream of tweets from a Kafka topic and filters them based on a predefined criteria.

This use case will cover:

  • Core producer-consumer functionality
  • Plaintext (non-SSL) communication setup

Order management system

assignee: @gayaldassanayake

This use case will cover:

  • Core producer-consumer functionality
  • Manual offset management
  • Encrypted (SSL enabled) communication setup
  • Stock trading analyzer
  • A stock trading system simulation built using Kafka.

Stock trading analyzer

assignee: @aashikam

This use case will cover:

  • Core producer-consumer functionality
  • //SASL authentication with Kafka broker
  • Encrypted (SSL enabled) communication setup
  • Banking transaction processor
  • A banking transaction processor that processes banking transactions using Kafka.

Banking transaction processor

assignee: @aashikam

This use case will cover:

  • Core producer-consumer functionality
  • mTLS based authentication setup with Kafka broker
  • Confluent Schema registry integration with Avro serialization

Troubleshooting guide

assignee: @aashikam

A comprehensive troubleshooting guide for Kafka-based event integrations in WSO2 Integrator: BI should be introduced to help developers efficiently diagnose and resolve issues encountered while working with the connector, ensuring a smoother development experience.

This guide will focus on troubleshooting key problem areas such as:

  • Connectivity issues (broker availability, SSL/TLS configurations, authentication configurations etc)
  • Serialization and deserialization issues
  • Schema registry integration related issues (Confluent schema registry)

Related documentation

Sub-issues

Metadata

Metadata

Type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions