Enables kafka-connect REST API to listen on specified port #198
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
By default the Kafka Connect REST API listens on port 8083. According to the documentation, the port should be configurable by specifying CONNECT_REST_PORT, but for a reason I could not identify this environment variable is not respected by the running process. The server process that runs for Kafka Connect will only be available on port 8083 regardless of this environment variable. Attempting to set CONNECT_PORT or CONNECT_REST_PORT in the container environment variables causes all dependent services and HTTP connections to point to the wrong port, because these processes respect the environment variable, but the actual service continues to run on port 8083. After digging through online documentation I found the configuration property that specifies the REST API listeners. https://docs.confluent.io/platform/current/connect/security.html#connect-rest-api-http This commit appends the listener interface and port to the connect-avro-distributed.properties file.
|
Should fix #197 |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
By default the Kafka Connect REST API listens on port 8083. According to the documentation, the port should be configurable by specifying CONNECT_REST_PORT, but for a reason I could not identify this environment variable is not respected by the running process. The server process that runs for Kafka Connect will only be available on port 8083 regardless of this environment variable.
Attempting to set CONNECT_PORT or CONNECT_REST_PORT in the container environment variables causes all dependent services and HTTP connections to point to the wrong port, because these processes respect the environment variable, but the actual service continues to run on port 8083.
After digging through online documentation I found the configuration property that specifies the REST API listeners.
https://docs.confluent.io/platform/current/connect/security.html#connect-rest-api-http
This commit appends the listener interface and port to the connect-avro-distributed.properties file.
To test the issue without this change, attempt to run the container by specifying
-e CONNECT_PORT=4004. After waiting an appropriate amount of time, it can be observed that no service ever listens on 4004 and inspecting the ports it can be observed that the kafka-connect service continues to listen on port 8083 despite the environment variable being specified.After this change, the service will begin to listen on the specified port.
Author's note: I'm unsure if modifying this file in the way I've done is the preferred approach by the primary contributors. This PR is a gift of work, and I'm not funded to support in any way beyond this, so if the PR is unacceptable or needs modifications, I probably won't be able to support.