Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Additional Logging for GWA Scheduler, Kube API Microservices #95

Open
jTendeck opened this issue May 2, 2023 · 0 comments
Open

Additional Logging for GWA Scheduler, Kube API Microservices #95

jTendeck opened this issue May 2, 2023 · 0 comments

Comments

@jTendeck
Copy link
Contributor

jTendeck commented May 2, 2023

We recently added gateway loopback tests to Gold and Gold DR. However, The loopback routes were not being created in the standby cluster (ie: Gold DR) in test and production environments. It seems there was an issue with the gwa-scheduler (which retrieves Kong configurations from the dataplane) as well as the kube-api (which actually deploys/syncs the routes). It appeared that the scheduler was able to retrieve the routes from Kong, however the routes weren't actually being synced.

There was not any immediate signs of an issue (eg: log errors, pods crashing, etc) within the scheduler or kube-api. To help pinpoint the issue, we should add additional logging to these microservices in case this happens again in the future. Logging should indicate what is happening within each microservice.

Note: the sync issue was resolved after simply restarting the the scheduler pods within each environment (Gold DR test + prod)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant