Pushing a large application sometimes results in "Insufficient Resources" even though the "availabable memory" metric shows cellls which should be able to easily accommodate the application.

[pusherofbrooms]

Current behavior

On occasion, when we push a large (6GB) application, we might receive an "Insufficient Resources" error, even though there are cells with plenty of memory to accommodate the application (a couple of cells had as much as 22GB free) according to the AvailableResources metric presented in cfdot celll-states. Here are some relevant notes about our environment:

• We use 128GB cells.
• Unlike our other CF deployments, this one sees heavy "task" usage by one of our clients.
• We are currently running v40.17.0 of cf-deployment
• There was a hint in the Cloud Foundry slack thread at https://cloudfoundry.slack.com/archives/C02HNDJB31R/p1723134840298499 that tasks might not be captured in the AvailableResources statistic.
• Adding a handful of cells allowed us to push applications normally.

Desired behavior

AvailableResources should accurately tell us if a large application can be pushed. Alternatively, if there is another metric we should be using to measure available resources, we'd like to know about it.

Affected Version

v40.17.0 of cf-deployment using diego v 2.100.0