2018 HPC Upgrade

During the Summer and Fall of 2018, we replaced our previous Penguin cluster with a new cluster from Dell. This upgrade/replacement is part of our normal 3-year cycle.

The current HPC configuration consists of 88 compute nodes with 3520 total CPU cores, 20736 GB total RAM and 61440 total GPU cores:

• Thin: 78 x PowerEdge C6420 Compute Nodes with Intel Skylake Gold 6148 Processors, 192 GB DDR4 RAM and EDR Infiniband.
• GPU: 6 x PowerEdge R740 GPU nodes with Intel Skylake Gold 6148 Processors, 192 GB DDR4 RAM, 2 x NVIDIA V100 GPU and EDR Infiniband - 5120 GPU cores/V100, 10240 GPU cores/GPU node
• Fat: 2 x PowerEdge R740 Fat Memory Nodes with Intel Skylake Gold 6148 Processors, 768 GB DDR4 RAM and EDR Infiniband
• Large Fat: 2 x PowerEdge R740 Fat Memory Nodes with Intel Skylake Gold 6148 Processors,1.5 TB DDR4 RAM and EDR Infiniband
• Parallel File System: DDN GS7K GRIDScalar (GPFS) w/ 120 x 4 TB HDD (480 TB total raw storage) providing up to 8.5GB/sec performance

All compute nodes are connected via EDR Infiniband (2:1 Blocking) and 1GbE for host/OOB management. Head and Login nodes are connected via EDR Infiniband and 10GbE for host/OOB management.