Replies: 4 comments 1 reply
-
Others are more expert than I, but since we just procured a new machine, I can give you some ideas to consider.
Another decision you will have to make is Intel versus AMD. Lots of opinions here. We have stayed with Intel since we use the OneAPI compilers. However, there is a lot of discussion about ARM chips in the future, but I suspect that is 5 years away for us. |
Beta Was this translation helpful? Give feedback.
-
Thanks |
Beta Was this translation helpful? Give feedback.
-
We use RHEL 9.3 (Plow) for our system and it works fine. Are you looking for just a single machine or a rack system with multiple server blades in it? For a rack system you are going to want a fast, high bandwidth network (we use InfiniBand). My experience is FDS scales well for larger meshes than Randy indicated. You could do a 10 million cell case on a single 64-core node (~50^3 mesh). It will obviously not run as fast as it would if you had more meshes with fewer cells per mesh. Disk storage is another concern. You want fast disks and a lot of storage. We have 20 Tb of strorage and have had single jobs that have consumed a third of it. Another thing to consider, especially with a rack system, is cooling. Each of our nodes disipates about 1 kW of heat when running at 100 % load. |
Beta Was this translation helpful? Give feedback.
-
Yes, the scaling depends on the system, and I was referring to national class HPC system where these strong scaling tests were performed. But this brings up a good point that we have not mentioned yet, which is you need to consider the Infiniband (IB) fabric. Do not try to do HPC with ethernet. I think by now that Mellanox is the standard. We spec'd HDR100 and a Mellanox Quantum (200 Gb/s) IB switch. |
Beta Was this translation helpful? Give feedback.
-
Hi
We are looking into the possibility of moving to running fds simolations on a Linux server.
Is there a guide that explains how to do this?
based on your experience are there any recommendations?
Thanks in advance
Beta Was this translation helpful? Give feedback.
All reactions