Site hangs in production

[HarelM]

Bug

The site hangs in production.
We need to find the root cause of this.
One possible way to understand this can be found here:
aspnet/KestrelHttpServer#1267
A guide can be found here:
https://github.com/dotnet/coreclr/blob/cc8de13a8853a76fb3eb99cc209a4986eb3b2585/Documentation/building/debugging-instructions.md#debugging-coreclr-on-linux

The following is also suggested there:
https://github.com/benaadams/Ben.BlockingDetector

Also the following might prove useful to extract a dump when there's an issue:
https://docs.microsoft.com/en-us/dotnet/core/diagnostics/dotnet-dump

[HarelM]

Open an issue in aspnet repo:
dotnet/aspnetcore#36274

[HarelM]

The following are the needed steps in order to install .net core sdk in the container
https://docs.microsoft.com/en-us/dotnet/core/install/linux-debian#debian-10-

apt-get install -y wget
wget https://packages.microsoft.com/config/debian/10/packages-microsoft-prod.deb -O packages-microsoft-prod.deb
dpkg -i packages-microsoft-prod.deb
apt-get update
apt-get install -y dotnet-sdk-5.0
dotnet tool install --tool-path /tools dotnet-trace
dotnet tool install --tool-path /tools dotnet-counters
dotnet tool install --tool-path /tools dotnet-dump
/tools/dotnet-dump collect -n dotnet

This will create a dump file that needs to be exported out of the container.

[HarelM]

After looking into the dump the main suspect is the lock.
In order to solve it I used the following article:
https://andrewlock.net/a-look-behind-the-jwt-bearer-authentication-middleware-in-asp-net-core/
Lock provider code
https://www.ryadel.com/en/asp-net-core-lock-threads-async-custom-ids-lockprovider/
https://github.com/Darkseal/LockProvider/blob/0034454aade119ddff30796b666027826ac3b6a0/LockProvider.cs#L1
And this comment:
AzureAD/azure-activedirectory-identitymodel-extensions-for-dotnet#468 (comment)
I hope this will allow me to close this annoying issue...