About the HPC system Cobra

Intel/Atos system with Intel Xeon Skylake CPUs and Nvidia Tesla V100 and Quadro RTX5000 GPUs

Supercomputer Cobra was installed in spring 2018, got expanded with NVIDIA Tesla V100 GPUs in Dec 2018 and with NVIDIA Quadro RTX 5000 GPUs in July 2019.

All compute nodes contain two Intel Xeon Gold 6148 processors (Skylake (SKL), 20 cores @ 2.4 GHz) and are connected through a 100 Gb/s OmniPath interconnect. Each island (~ 636 nodes) has a non-blocking, full fat tree network topology, while among islands a blocking factor of 1:8 applies. Therefore batch jobs are restricted to a single island. In addition there are 6 login nodes and an I/O subsystem that serves 5 PetaByte of disk storage with direct HSM access (via GHI).

Overall configuration:

• 1284 compute nodes (2 x SKL), 96 GB RAM DDR4 each
• 1908 compute nodes (2 x SKL), 192 GB RAM DDR4 each
• 16 compute nodes (2 x SKL), 384 GB RAM DDR4 each)
• 8 compute nodes (2x SKL), 768 GB RAM DDR4 each
• 64 compute nodes (2 x SKL + 2 x NVIDIA Tesla V100-32)
• 120 compute nodes (2 x SKL + 2 x NVIDIA Quadro RTX 5000)
• 24 compute nodes (2 x SKL), 192 GB RAM DDR4 each (dedicated to MPSD)

Totals: 3424 compute nodes, 136,960 CPU-cores, 128 Tesla V100-32 GPUs, 240 Quadro RTX 5000 GPUs, 529 TB RAM DDR4, 7.9 TB HBM2, 11.4 PFlop/s peak (FP64) + 2.64 PFlop/s peak (FP32)