Add kafka resources for ephemeral usage #1207
Open
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Link(s) to Jira
Description of Intent of Change(s)
The what, why and how.
This new template will standup Kafka resources for our connectors to use in ephemeral. The reason I am standing up our own resources instead of using what's already deployed by Clowder is so we can set references in parameters. Clowder doesn't expose that info in a way that we can automatically populate a connector template to use.
It may make more sense for the this template to be in a separate repo.
Local Testing
How can the feature be exercised?
How can the bug be exploited and fix confirmed?
Is any special local setup required?
To test out the template:
bonfire namespace reserve
bonfire deploy rbac
In your namespace you will see the resources start to come up. It will take several minutes.
Once the pieces are showing as ready (kafka will be Warning, Warning, Ready) you can test the source connector by adding a record to
public.management_outbox
and checking the topicoutbox.event.test
for a new message.Steps to do that would be:
rbac-db
.$ psql -h <HOST> -d rbac -U <USER> -W
public.management_outbox
.INSERT INTO public.management_outbox VALUES ('<UUID>', 'foo', 'bar', 'baz', '{}');
$ /opt/kafka/bin/kafka-console-consumer.sh --bootstrap-server=<BOOTSTRAP_SERVER> --from-beginning --topic=outbox.event.test
You should see your message appear!
Checklist
Secure Coding Practices Checklist Link
Secure Coding Practices Checklist