Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Enabling 9.0.0 kibana support for kubernetes, kubernetes_otel, nginx_ingress, istio and containerd integrations #12535

Open
wants to merge 2 commits into
base: main
Choose a base branch
from

Conversation

gizas
Copy link
Contributor

@gizas gizas commented Jan 30, 2025

  • Enhancement

Dont merge until I run once the tests as described here
We will need to put only 9.0.0 in constrains, trigger the buidkite pipeline and then revert again

Tested with command https://github.com/elastic/integrations/pull/12535#issuecomment-2627285200 : /test stack 9.0.0-SNAPSHOT

Proposed commit message

  • WHAT: Enabling support for kubernetes, kubernetes_otel, nginx_ingress, istio and containerd integrations
  • WHY: Is needed in order to enable above integrations in version 9.0.0

Checklist

  • I have reviewed tips for building integrations and this pull request is aligned with them.
  • I have verified that all data streams collect metrics or logs.
  • I have added an entry to my package's changelog.yml file.
  • I have verified that Kibana version constraints are current according to guidelines.
  • I have verified that any added dashboard complies with Kibana's Dashboard good practices

How to test this PR locally

  1. Clone Pr
  2. elastic-package build with v0.109.1
  3. elastic-package stack up -d -v --version=9.0.0-SNAPSHOT to install a local ES
  4. Install an agent + Fleet with prementioned integrations enabled

Related issues

Logs

Below validation errors fixed for istio and containerd
Containerd

Error: building package failed: invalid content found in built zip package: found 7 validation errors:
   1. file "/Users/andreasgkizas/elastic/integrations/build/packages/containerd-0.5.0.zip/data_stream/blkio/fields/fields.yml" is invalid: field 0: Additional property release is not allowed
   2. file "/Users/andreasgkizas/elastic/integrations/build/packages/containerd-0.5.0.zip/data_stream/cpu/fields/fields.yml" is invalid: field 0: Additional property release is not allowed
   3. file "/Users/andreasgkizas/elastic/integrations/build/packages/containerd-0.5.0.zip/data_stream/memory/fields/fields.yml" is invalid: field 0: Additional property release is not allowed
   4. file "/Users/andreasgkizas/elastic/integrations/build/packages/containerd-0.5.0.zip/manifest.yml" is invalid: field (root): Additional property license is not allowed
   5. file "/Users/andreasgkizas/elastic/integrations/build/packages/containerd-0.5.0.zip/manifest.yml" is invalid: field (root): Additional property release is not allowed
   6. file "/Users/andreasgkizas/elastic/integrations/build/packages/containerd-0.5.0.zip/manifest.yml" is invalid: field owner: type is required
   7. file "/Users/andreasgkizas/elastic/integrations/build/packages/containerd-0.5.0.zip/manifest.yml" is invalid: field conditions: Additional property kibana.version is not allowed


Istio:

Error: building package failed: invalid content found in built zip package: found 6 validation errors:
   1. file "/Users/andreasgkizas/elastic/integrations/build/packages/istio-0.7.0.zip/data_stream/access_logs/elasticsearch/ingest_pipeline/default.yml" is invalid: field processors.47.remove.field: rename "message" to "event.original" processor requires remove "message" processor (JSE00001)
   2. file "/Users/andreasgkizas/elastic/integrations/build/packages/istio-0.7.0.zip/data_stream/access_logs/elasticsearch/ingest_pipeline/default.yml" is invalid: field processors.47.remove.if: rename "message" to "event.original" processor requires remove "message" processor with if: 'ctx.event?.original != null' (JSE00001)
   3. file "/Users/andreasgkizas/elastic/integrations/build/packages/istio-0.7.0.zip/manifest.yml" is invalid: field (root): Additional property release is not allowed
   4. file "/Users/andreasgkizas/elastic/integrations/build/packages/istio-0.7.0.zip/manifest.yml" is invalid: field (root): Additional property license is not allowed
   5. file "/Users/andreasgkizas/elastic/integrations/build/packages/istio-0.7.0.zip/manifest.yml" is invalid: field owner: type is required
   6. file "/Users/andreasgkizas/elastic/integrations/build/packages/istio-0.7.0.zip/manifest.yml" is invalid: field conditions: Additional property kibana.version is not allowed

Screenshots

K8s

![k8s1](https://github.com/user-attachments/assets/1366461a-1fd6-43

k8s2
6d-af4e-cfebfe13e0ff)

K8s Otel

k8s0tel

Containerd

containerd

Istio

istiod

Ingress-Controller

ingress

Overall

Screenshot 2025-01-30 at 4 39 30 PM

@gizas gizas requested a review from a team as a code owner January 30, 2025 14:56
@gizas gizas added the Team:obs-ds-hosted-services Label for the Observability Hosted Services team [elastic/obs-ds-hosted-services] label Jan 30, 2025
Signed-off-by: Andreas Gkizas <[email protected]>
@elastic-vault-github-plugin-prod

🚀 Benchmarks report

To see the full report comment with /test benchmark fullreport

@elasticmachine
Copy link

💚 Build Succeeded

@andrewkroh andrewkroh added Integration:containerd Containerd Integration:nginx_ingress_controller Nginx Ingress Controller Logs Integration:kubernetes Kubernetes Integration:istio Istio Integration:kubernetes_otel Kubernetes OpenTelemetry Assets Team:Cloudnative-Monitoring Label for the Cloud Native Monitoring team [elastic/obs-cloudnative-monitoring] labels Jan 30, 2025
@gizas
Copy link
Contributor Author

gizas commented Jan 31, 2025

/test stack 9.0.0-SNAPSHOT

@elasticmachine
Copy link

💚 Build Succeeded

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Integration:containerd Containerd Integration:istio Istio Integration:kubernetes_otel Kubernetes OpenTelemetry Assets Integration:kubernetes Kubernetes Integration:nginx_ingress_controller Nginx Ingress Controller Logs Team:Cloudnative-Monitoring Label for the Cloud Native Monitoring team [elastic/obs-cloudnative-monitoring] Team:obs-ds-hosted-services Label for the Observability Hosted Services team [elastic/obs-ds-hosted-services]
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants