Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Read affinity args are not added to (CephFS/RBD) NodePlugin #158

Open
iPraveenParihar opened this issue Oct 17, 2024 · 4 comments
Open

Read affinity args are not added to (CephFS/RBD) NodePlugin #158

iPraveenParihar opened this issue Oct 17, 2024 · 4 comments
Labels
bug Something isn't working wontfix This will not be worked on

Comments

@iPraveenParihar
Copy link
Contributor

Describe the bug

I see a way to enable read affinity and pass crush location labels in CephConnection CR which I did

$ k get cephconnections.csi.ceph.io ceph-cluster -ojsonpath='{.spec}' | jq
{
  "monitors": [
    "10.98.80.66:6789"
  ],
  "readAffinity": {
    "crushLocationLabels": [
      "kubernetes.io/hostname",
      "topology.kubernetes.io/region",
      "topology.kubernetes.io/zone",
      "topology.rook.io/chassis",
      "topology.rook.io/rack",
      "topology.rook.io/row",
      "topology.rook.io/pdu",
      "topology.rook.io/pod",
      "topology.rook.io/room",
      "topology.rook.io/datacenter"
    ]
  }
}

But still the read affinity args not added to (cephfs/rbd) nodeplugin.
Looks like, we missed adding those?

AllowPrivilegeEscalation: ptr.To(true),
},
Args: utils.DeleteZeroValues(
[]string{
utils.LogVerbosityContainerArg(logVerbosity),
utils.TypeContainerArg(string(r.driverType)),
utils.NodeServerContainerArg,
utils.NodeIdContainerArg,
utils.DriverNameContainerArg(r.driver.Name),
utils.EndpointContainerArg,
utils.PidlimitContainerArg,
utils.If(forceKernelClient, utils.ForceCephKernelClientContainerArg, ""),
utils.If(
ptr.Deref(r.driver.Spec.DeployCsiAddons, false),
utils.CsiAddonsEndpointContainerArg,
"",
),
utils.If(
r.isRdbDriver(),
utils.StagingPathContainerArg(kubeletDirPath),
"",
),
utils.If(
r.isCephFsDriver(),
utils.KernelMountOptionsContainerArg(r.driver.Spec.KernelMountOptions),
"",
),
utils.If(
r.isCephFsDriver(),
utils.FuseMountOptionsContainerArg(r.driver.Spec.FuseMountOptions),
"",
),
utils.If(
topology,
utils.DomainLabelsContainerArg(domainLabels),
"",
),
utils.If(logRotationEnabled, utils.LogToStdErrContainerArg, ""),
utils.If(logRotationEnabled, utils.AlsoLogToStdErrContainerArg, ""),
utils.If(
logRotationEnabled,
utils.LogFileContainerArg(fmt.Sprintf("csi-%splugin", r.driverType)),
"",
),
},
),
Env: []corev1.EnvVar{

ceph-csi reference - https://github.com/ceph/ceph-csi/blob/8ddb615df28f5b9dabfb92fad12565206813a04c/deploy/rbd/kubernetes/csi-rbdplugin.yaml#L50-L57

@Madhu-1
Copy link
Collaborator

Madhu-1 commented Oct 18, 2024

Yes it looks like, please feel free to assign it if you are planning to work on it.

@Madhu-1 Madhu-1 added the bug Something isn't working label Oct 18, 2024
@iPraveenParihar
Copy link
Contributor Author

Thought about it 🤔, I checked the ceph-csi implementation of readAffinity and the nodePlugin arg --crush-location-labels (--enable-read-affinity=true, defaults false) are consider only when the readAffinity: true and crushLocationLabels is empty in ceph-csi-config ConfigMap.

initially, the readAffinity was provided from nodeplugin args but later we moved it to ceph-csi-config CM. But nodeplugin args stayed for backward compatibility. I think in operator it actually doesn't require to add the readAffinity args in nodeplugin. Users moving to operator deployment should take care of setting readAffinity as required.

@Madhu-1, do you have different thoughts on this?

@Madhu-1
Copy link
Collaborator

Madhu-1 commented Oct 21, 2024

Thought about it 🤔, I checked the ceph-csi implementation of readAffinity and the nodePlugin arg --crush-location-labels (--enable-read-affinity=true, defaults false) are consider only when the readAffinity: true and crushLocationLabels is empty in ceph-csi-config ConfigMap.

initially, the readAffinity was provided from nodeplugin args but later we moved it to ceph-csi-config CM. But nodeplugin args stayed for backward compatibility. I think in operator it actually doesn't require to add the readAffinity args in nodeplugin. Users moving to operator deployment should take care of setting readAffinity as required.

@Madhu-1, do you have different thoughts on this?

Now i remember that was the reason we considered not to add it to the NodePlugin but rather kept it at configmap, if the feature is not working as expected we can add it to the Cli argument, please test out the functionality and see if its working as expected or not.

Copy link

This issue has been automatically marked as stale because it has not had recent activity. It will be closed in a week if no further activity occurs. Thank you for your contributions.

@github-actions github-actions bot added the wontfix This will not be worked on label Dec 20, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working wontfix This will not be worked on
Projects
None yet
Development

No branches or pull requests

2 participants