Steps for Content Creation, Publishing, Course Certification & Kafka Dependencies

[siddhishinde0723]

We need detailed steps for the following processes:

Content Creation, Publishing, and Course Certification:

1. Which jobs handle each process?
2. What Kafka topics are involved for input and output at each stage?
3. How are consumer groups created in Kafka?
4. Are there any additional service configurations required for the same?
5. Is there any dependency on the Kafka version?

Kafka Version Dependency Issue:

1. We are using an older version of Kafka and are facing issues while creating the Kafka input topic "dev.knowlg.learning.event".
2. Additionally, we are unable to check the output Kafka topic for the same in knowledge platform jobs.

Content Search Issue:

1. I can read the content, but the search functionality is not working.
2. Initially, the search API returned an error due to missing Elasticsearch keywords. After creating the required keywords, that issue was resolved. However, the search count is still returning 0.
3. Upon further investigation, we found that the data exists in Neo4j, but the required Kafka search index consumer group is missing.
4. To resolve this, we need to create the necessary Kafka consumer group.

Request:
Please provide detailed steps, configurations, and dependencies to resolve the above issues.
Any insights into debugging the Kafka topic creation issue would be helpful.

cc: @pallakartheekreddy @parthlawate @AbhilashKD @coolbung @jona-r