Compute nodes

Rocket has 123 compute nodes in total, comprising:

110 standard nodes, each with:

• 2 Intel Xeon E5-2699 v4 processors (2.2 GHz, 22 cores, 55 MB cache)
• 44 cores (2 processors * 22 cores), totalling 4840 across the standard nodes
• 128 GB memory - (8 DDR4 RDIMMs, each with 16GB) – ie. 2.9 GB per core
• 600 GB SAS disk (469 GB scratch space)

6 medium (M) nodes:

• 2 Intel Xeon E5-2699 v4 processors (2.2 GHz, 22 cores, 55 MB cache)
• 44 cores (2 processors * 22 cores), totalling 264 across the medium nodes
• 512 GB memory - (16 DDR4 RDIMMs, each with 32GB) – ie. 11.6 GB per core
• 1200 GB SAS disk (1.1 TB scratch space) 

4 large (L) nodes:

• 2 Intel Xeon E5-2699 v4 processors (2.2 GHz, 22 cores, 55 MB cache)
• 44 cores (2 processors * 22 cores), totalling 176 across the large nodes
• 512 GB memory - (16 DDR4 RDIMMs, each with 32GB) – ie. 11.6 GB per core
• 2 * 4000 GB SAS disks (7.2 TB scratch space)

2 extra-large (XL) nodes:

• 4 Intel Xeon E7-4830 v4 processors (2.0 GHz, 14 cores, 35 MB cache)
• 56 cores (4 processors * 14 cores), totalling 112 across the extra-large nodes
• 1536 GB memory - (48 DDR4 RDIMMs, each with 32GB) – ie. 27.4 GB per core
• 8 * 1200 GB SAS disks (8.7 TB scratch space)

1 GPU node:

• 2 * 16 core IBM POWER9 processors (2.6GHz, 3.09 GHz Turbo)
• 4 NVIDIA Tesla V100 GPUs, each with 16GB VRAM and NVLink2 interconnect 
• 256 GB memory
• 893 GB scratch space

File storage

The main data filestore is a 500TB Lustre parallel file system. 

Home directories are on a 20TB filesystem accessed via NFS

Interconnect

Mellanox Enhanced Data Rate (EDR) 100Gbps InfiniBand. 

Nodes within a rack (16 nodes, 704 cores) form an island with 1:1 blocking.  Otherwise the blocking ratio is 16:9.