Start installing various Kafka CLI tools in ca-kafka-local plugin #36
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
jasononeil
force-pushed
the
jasono/kafkactl
branch
from
930ddae to
1c6ef4d
Compare
jasononeil
changed the title
|
Even though in my opinion most of the tasks required can all be done with one tool and more tools only increase cognitive load, at this stage might be better just provides all of them. |
cultureamp-brucew
previously approved these changes
Aug 21, 2024
jasononeil
force-pushed
the
jasono/kafkactl
branch
from
30d35a3 to
6001eb6
Compare
This will make it easier for us to add topics, among other things
For example:
kafkactl create topic local.jasontopic.v1
There's still some discussion around if this is the right CLI for the job.
kafkactl looked like one of the nicer options to me, but kaf and kcat are both already in use elsewhere at Culture Amp, so we might as well match the technology choices. Add missing kcat config
jasononeil
force-pushed
the
jasono/kafkactl
branch
from
05e90a2 to
673b90d
Compare
jasononeil
force-pushed
the
jasono/kafkactl
branch
from
673b90d to
b94b4c7
Compare
cultureamp-brucew
approved these changes
Aug 21, 2024
cset00
approved these changes
Aug 21, 2024
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
This will make it easier for us to add topics, among other things.
The tools installed are:
All 3 tools are small binaries and don't add much weight to the plugin. Kaf and Kcat are already in use elsewhere at Culture Amp, but kafkactl appeared to me to have the nicest combination of UI + docs, so I think is worth including.
I've used
envsubstto create templated config files for each, and needed a small wrapper script to set the--configflag for kaf (for both kcat and kafkactl I was able to set the config path with an environment variable so didn't need a wrapper script).Example to create a topic:
Jira card: https://cultureamp.atlassian.net/browse/FEF-1538