Compute System Details
During the quarterly maintenance cycle on April 27, 2022 the ElGato K20s and Ocelote K80s were removed because they are no longer supported by Nvidia.
Name | El Gato | Ocelote | Puma |
---|---|---|---|
Model | IBM System X iDataPlex dx360 M4 | Lenovo NeXtScale nx360 M5 | Penguin Altus XE2242 |
Year Purchased | 2013 | 2016 (2018 P100 nodes) | 2020 |
Node Count | 131 | 400 | 236 CPU-only |
Total System Memory (TB) | 26TB | 82.6TB | 128TB |
Processors | 2x Xeon E5-2650v2 8-core (Ivy Bridge) | 2x Xeon E5-2695v3 14-core (Haswell) | 2x AMD EPYC 7642 48-core (Rome) |
Cores / Node (schedulable) | 16c | 28c (48c - High-memory node) | 94c |
Total Cores | 2160* | 11528* | 23616* |
Processor Speed | 2.66GHz | 2.3GHz (2.4GHz - Broadwell CPUs) | 2.4GHz |
Memory / Node | 256GB - GPU nodes | 192GB (2TB - High-memory node) | 512GB (3TB - High-memory nodes) |
Accelerators | 46 NVIDIA P100 (16GB) | 29 NVIDIA V100S | |
/tmp | ~840 GB spinning /tmp is part of root filesystem | ~840 GB spinning /tmp is part of root filesystem | ~1440 TB NVMe /tmp |
HPL Rmax (TFlop/s) | 46 | 382 | |
OS | Centos 7 | CentOS 7 | CentOS 7 |
Interconnect | FDR Inifinband | FDR Infiniband for node-node 10 Gb Ethernet node-storage | 1x 25Gb/s Ethernet RDMA (RoCEv2) |
* Includes high-memory and GPU node CPUs
Example Resource Requests
See our User Guide under Running Jobs with SLURM → Example Resource Requests.