What could be the reasons that Karmada search is not syncing data to the OpenSearch backend store? #5753
Labels
kind/question
Indicates an issue that is a support question.
Comments
mohamedawnallah
added
the
kind/question
|
I would appreciate any thoughts on this @zhzhuang-zju, @XiShanYongYe-Chang! 🙏 |
|
I'm delayed on Milestone 7 because I haven't been able to figure this out. I've followed the Karmada search document on multi-cloud search but still can't reproduce the intended results of cached data to be deployed automatically to the backend store. Steps I’ve Taken:
The logs for the Karmada search deployment appear the same or unchanged: Let me know if this helps clarify! 🙏 |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Please provide an in-depth description of the question you have:
I've been following the Karmada search documentation, but data hasn't been automatically uploaded to the OpenSearch backend. Additionally, the logs show no indication of when syncing happens with the backend store.
Logs:
Context
hack/local-up-karmada.shdev@test:$ cat deployment-search.yaml apiVersion: search.karmada.io/v1alpha1 kind: ResourceRegistry metadata: name: deployment-search spec: backendStore: openSearch: addresses: - http://karmada-opensearch.karmada-system.svc:9200 targetCluster: clusterNames: resourceSelectors: - apiVersion: apps/v1 kind: Deploymentdev@test:$ kubectl --kubeconfig $HOME/.kube/karmada.config --context karmada-apiserver get --raw /apis/search.karmada.io/v1alpha1/search/cache/apis/apps/v1/deployments{ "apiVersion": "apps/v1", "items": [ { "apiVersion": "apps/v1", "kind": "Deployment", "metadata": { "annotations": { "deployment.kubernetes.io/revision": "1", "kubectl.kubernetes.io/last-applied-configuration": "{\"apiVersion\":\"apps/v1\",\"kind\":\"Deployment\",\"metadata\":{\"annotations\":{},\"labels\":{\"app\":\"nginx\"},\"name\":\"nginx\",\"namespace\":\"default\"},\"spec\":{\"replicas\":2,\"selector\":{\"matchLabels\":{\"app\":\"nginx\"}},\"template\":{\"metadata\":{\"labels\":{\"app\":\"nginx\"}},\"spec\":{\"containers\":[{\"image\":\"nginx\",\"name\":\"nginx\"}]}}}}\n", "propagationpolicy.karmada.io/name": "nginx-propagation", "propagationpolicy.karmada.io/namespace": "default", "resource.karmada.io/cached-from-cluster": "member1", "resourcebinding.karmada.io/name": "nginx-deployment", "resourcebinding.karmada.io/namespace": "default", "resourcetemplate.karmada.io/generation": "2", "resourcetemplate.karmada.io/managed-annotations": "kubectl.kubernetes.io/last-applied-configuration,propagationpolicy.karmada.io/name,propagationpolicy.karmada.io/namespace,resourcebinding.karmada.io/name,resourcebinding.karmada.io/namespace,resourcetemplate.karmada.io/generation,resourcetemplate.karmada.io/managed-annotations,resourcetemplate.karmada.io/managed-labels,resourcetemplate.karmada.io/uid,work.karmada.io/conflict-resolution,work.karmada.io/name,work.karmada.io/namespace", "resourcetemplate.karmada.io/managed-labels": "app,karmada.io/managed,propagationpolicy.karmada.io/permanent-id,resourcebinding.karmada.io/permanent-id,work.karmada.io/permanent-id", "resourcetemplate.karmada.io/uid": "ee0cceb3-2902-4bcd-9695-e4916ca1e157", "work.karmada.io/conflict-resolution": "abort", "work.karmada.io/name": "nginx-687f7fb96f", "work.karmada.io/namespace": "karmada-es-member1" }, "creationTimestamp": "2024-10-27T20:52:11Z", "generation": 1, "labels": { "app": "nginx", "karmada.io/managed": "true", "propagationpolicy.karmada.io/permanent-id": "6af11235-0eec-4bca-9934-0093a729fd0d", "resourcebinding.karmada.io/permanent-id": "7dda689f-56b6-4b22-b455-3d6d6a670e2d", "work.karmada.io/permanent-id": "f7e634b4-4e95-49d6-9a40-257d24a7d3d5" }, "managedFields": [ { "apiVersion": "apps/v1", "fieldsType": "FieldsV1", "fieldsV1": { "f:metadata": { "f:annotations": { ".": {}, "f:kubectl.kubernetes.io/last-applied-configuration": {}, "f:propagationpolicy.karmada.io/name": {}, "f:propagationpolicy.karmada.io/namespace": {}, "f:resourcebinding.karmada.io/name": {}, "f:resourcebinding.karmada.io/namespace": {}, "f:resourcetemplate.karmada.io/generation": {}, "f:resourcetemplate.karmada.io/managed-annotations": {}, "f:resourcetemplate.karmada.io/managed-labels": {}, "f:resourcetemplate.karmada.io/uid": {}, "f:work.karmada.io/conflict-resolution": {}, "f:work.karmada.io/name": {}, "f:work.karmada.io/namespace": {} }, "f:labels": { ".": {}, "f:app": {}, "f:karmada.io/managed": {}, "f:propagationpolicy.karmada.io/permanent-id": {}, "f:resourcebinding.karmada.io/permanent-id": {}, "f:work.karmada.io/permanent-id": {} } }, "f:spec": { "f:progressDeadlineSeconds": {}, "f:replicas": {}, "f:revisionHistoryLimit": {}, "f:selector": {}, "f:strategy": { "f:rollingUpdate": { ".": {}, "f:maxSurge": {}, "f:maxUnavailable": {} }, "f:type": {} }, "f:template": { "f:metadata": { "f:labels": { ".": {}, "f:app": {} } }, "f:spec": { "f:containers": { "k:{\"name\":\"nginx\"}": { ".": {}, "f:image": {}, "f:imagePullPolicy": {}, "f:name": {}, "f:resources": {}, "f:terminationMessagePath": {}, "f:terminationMessagePolicy": {} } }, "f:dnsPolicy": {}, "f:restartPolicy": {}, "f:schedulerName": {}, "f:securityContext": {}, "f:terminationGracePeriodSeconds": {} } } } }, "manager": "karmada-controller-manager", "operation": "Update", "time": "2024-10-27T20:52:11Z" }, { "apiVersion": "apps/v1", "fieldsType": "FieldsV1", "fieldsV1": { "f:metadata": { "f:annotations": { "f:deployment.kubernetes.io/revision": {} } }, "f:status": { "f:availableReplicas": {}, "f:conditions": { ".": {}, "k:{\"type\":\"Available\"}": { ".": {}, "f:lastTransitionTime": {}, "f:lastUpdateTime": {}, "f:message": {}, "f:reason": {}, "f:status": {}, "f:type": {} }, "k:{\"type\":\"Progressing\"}": { ".": {}, "f:lastTransitionTime": {}, "f:lastUpdateTime": {}, "f:message": {}, "f:reason": {}, "f:status": {}, "f:type": {} } }, "f:observedGeneration": {}, "f:readyReplicas": {}, "f:replicas": {}, "f:updatedReplicas": {} } }, "manager": "kube-controller-manager", "operation": "Update", "subresource": "status", "time": "2024-10-27T20:52:13Z" } ], "name": "nginx", "namespace": "default", "resourceVersion": "45343", "uid": "df228e48-289b-4723-bbc0-e4bd5a23427d" }, "spec": { "progressDeadlineSeconds": 600, "replicas": 1, "revisionHistoryLimit": 10, "selector": { "matchLabels": { "app": "nginx" } }, "strategy": { "rollingUpdate": { "maxSurge": "25%", "maxUnavailable": "25%" }, "type": "RollingUpdate" }, "template": { "metadata": { "creationTimestamp": null, "labels": { "app": "nginx" } }, "spec": { "containers": [ { "image": "nginx", "imagePullPolicy": "Always", "name": "nginx", "resources": {}, "terminationMessagePath": "/dev/termination-log", "terminationMessagePolicy": "File" } ], "dnsPolicy": "ClusterFirst", "restartPolicy": "Always", "schedulerName": "default-scheduler", "securityContext": {}, "terminationGracePeriodSeconds": 30 } } }, "status": { "availableReplicas": 1, "conditions": [ { "lastTransitionTime": "2024-10-27T20:52:13Z", "lastUpdateTime": "2024-10-27T20:52:13Z", "message": "Deployment has minimum availability.", "reason": "MinimumReplicasAvailable", "status": "True", "type": "Available" }, { "lastTransitionTime": "2024-10-27T20:52:11Z", "lastUpdateTime": "2024-10-27T20:52:13Z", "message": "ReplicaSet \"nginx-676b6c5bbc\" has successfully progressed.", "reason": "NewReplicaSetAvailable", "status": "True", "type": "Progressing" } ], "observedGeneration": 1, "readyReplicas": 1, "replicas": 1, "updatedReplicas": 1 } }, { "apiVersion": "apps/v1", "kind": "Deployment", "metadata": { "annotations": { "deployment.kubernetes.io/revision": "1", "kubectl.kubernetes.io/last-applied-configuration": "{\"apiVersion\":\"apps/v1\",\"kind\":\"Deployment\",\"metadata\":{\"annotations\":{},\"labels\":{\"app\":\"nginx\"},\"name\":\"nginx\",\"namespace\":\"default\"},\"spec\":{\"replicas\":2,\"selector\":{\"matchLabels\":{\"app\":\"nginx\"}},\"template\":{\"metadata\":{\"labels\":{\"app\":\"nginx\"}},\"spec\":{\"containers\":[{\"image\":\"nginx\",\"name\":\"nginx\"}]}}}}\n", "propagationpolicy.karmada.io/name": "nginx-propagation", "propagationpolicy.karmada.io/namespace": "default", "resource.karmada.io/cached-from-cluster": "member2", "resourcebinding.karmada.io/name": "nginx-deployment", "resourcebinding.karmada.io/namespace": "default", "resourcetemplate.karmada.io/generation": "2", "resourcetemplate.karmada.io/managed-annotations": "kubectl.kubernetes.io/last-applied-configuration,propagationpolicy.karmada.io/name,propagationpolicy.karmada.io/namespace,resourcebinding.karmada.io/name,resourcebinding.karmada.io/namespace,resourcetemplate.karmada.io/generation,resourcetemplate.karmada.io/managed-annotations,resourcetemplate.karmada.io/managed-labels,resourcetemplate.karmada.io/uid,work.karmada.io/conflict-resolution,work.karmada.io/name,work.karmada.io/namespace", "resourcetemplate.karmada.io/managed-labels": "app,karmada.io/managed,propagationpolicy.karmada.io/permanent-id,resourcebinding.karmada.io/permanent-id,work.karmada.io/permanent-id", "resourcetemplate.karmada.io/uid": "ee0cceb3-2902-4bcd-9695-e4916ca1e157", "work.karmada.io/conflict-resolution": "abort", "work.karmada.io/name": "nginx-687f7fb96f", "work.karmada.io/namespace": "karmada-es-member2" }, "creationTimestamp": "2024-10-27T20:52:11Z", "generation": 1, "labels": { "app": "nginx", "karmada.io/managed": "true", "propagationpolicy.karmada.io/permanent-id": "6af11235-0eec-4bca-9934-0093a729fd0d", "resourcebinding.karmada.io/permanent-id": "7dda689f-56b6-4b22-b455-3d6d6a670e2d", "work.karmada.io/permanent-id": "27f297b9-f0c9-42ac-aa3e-0ed66521e202" }, "managedFields": [ { "apiVersion": "apps/v1", "fieldsType": "FieldsV1", "fieldsV1": { "f:metadata": { "f:annotations": { ".": {}, "f:kubectl.kubernetes.io/last-applied-configuration": {}, "f:propagationpolicy.karmada.io/name": {}, "f:propagationpolicy.karmada.io/namespace": {}, "f:resourcebinding.karmada.io/name": {}, "f:resourcebinding.karmada.io/namespace": {}, "f:resourcetemplate.karmada.io/generation": {}, "f:resourcetemplate.karmada.io/managed-annotations": {}, "f:resourcetemplate.karmada.io/managed-labels": {}, "f:resourcetemplate.karmada.io/uid": {}, "f:work.karmada.io/conflict-resolution": {}, "f:work.karmada.io/name": {}, "f:work.karmada.io/namespace": {} }, "f:labels": { ".": {}, "f:app": {}, "f:karmada.io/managed": {}, "f:propagationpolicy.karmada.io/permanent-id": {}, "f:resourcebinding.karmada.io/permanent-id": {}, "f:work.karmada.io/permanent-id": {} } }, "f:spec": { "f:progressDeadlineSeconds": {}, "f:replicas": {}, "f:revisionHistoryLimit": {}, "f:selector": {}, "f:strategy": { "f:rollingUpdate": { ".": {}, "f:maxSurge": {}, "f:maxUnavailable": {} }, "f:type": {} }, "f:template": { "f:metadata": { "f:labels": { ".": {}, "f:app": {} } }, "f:spec": { "f:containers": { "k:{\"name\":\"nginx\"}": { ".": {}, "f:image": {}, "f:imagePullPolicy": {}, "f:name": {}, "f:resources": {}, "f:terminationMessagePath": {}, "f:terminationMessagePolicy": {} } }, "f:dnsPolicy": {}, "f:restartPolicy": {}, "f:schedulerName": {}, "f:securityContext": {}, "f:terminationGracePeriodSeconds": {} } } } }, "manager": "karmada-controller-manager", "operation": "Update", "time": "2024-10-27T20:52:11Z" }, { "apiVersion": "apps/v1", "fieldsType": "FieldsV1", "fieldsV1": { "f:metadata": { "f:annotations": { "f:deployment.kubernetes.io/revision": {} } }, "f:status": { "f:availableReplicas": {}, "f:conditions": { ".": {}, "k:{\"type\":\"Available\"}": { ".": {}, "f:lastTransitionTime": {}, "f:lastUpdateTime": {}, "f:message": {}, "f:reason": {}, "f:status": {}, "f:type": {} }, "k:{\"type\":\"Progressing\"}": { ".": {}, "f:lastTransitionTime": {}, "f:lastUpdateTime": {}, "f:message": {}, "f:reason": {}, "f:status": {}, "f:type": {} } }, "f:observedGeneration": {}, "f:readyReplicas": {}, "f:replicas": {}, "f:updatedReplicas": {} } }, "manager": "kube-controller-manager", "operation": "Update", "subresource": "status", "time": "2024-10-27T20:52:12Z" } ], "name": "nginx", "namespace": "default", "resourceVersion": "45337", "uid": "e27ceb5a-a093-422c-91fc-2f5c77d1b151" }, "spec": { "progressDeadlineSeconds": 600, "replicas": 1, "revisionHistoryLimit": 10, "selector": { "matchLabels": { "app": "nginx" } }, "strategy": { "rollingUpdate": { "maxSurge": "25%", "maxUnavailable": "25%" }, "type": "RollingUpdate" }, "template": { "metadata": { "creationTimestamp": null, "labels": { "app": "nginx" } }, "spec": { "containers": [ { "image": "nginx", "imagePullPolicy": "Always", "name": "nginx", "resources": {}, "terminationMessagePath": "/dev/termination-log", "terminationMessagePolicy": "File" } ], "dnsPolicy": "ClusterFirst", "restartPolicy": "Always", "schedulerName": "default-scheduler", "securityContext": {}, "terminationGracePeriodSeconds": 30 } } }, "status": { "availableReplicas": 1, "conditions": [ { "lastTransitionTime": "2024-10-27T20:52:12Z", "lastUpdateTime": "2024-10-27T20:52:12Z", "message": "Deployment has minimum availability.", "reason": "MinimumReplicasAvailable", "status": "True", "type": "Available" }, { "lastTransitionTime": "2024-10-27T20:52:11Z", "lastUpdateTime": "2024-10-27T20:52:12Z", "message": "ReplicaSet \"nginx-676b6c5bbc\" has successfully progressed.", "reason": "NewReplicaSetAvailable", "status": "True", "type": "Progressing" } ], "observedGeneration": 1, "readyReplicas": 1, "replicas": 1, "updatedReplicas": 1 } }, ], "kind": "DeploymentList", "metadata": {} }What do you think about this question?:
I'm expecting data from
member1andmember2clusters to automatically upload to OpenSearch, as shown in the following image part of the doc mentioned above. Is there anything I'm missing?The text was updated successfully, but these errors were encountered: