System Architecture

System Architecture

voyager_overview.jpg

Hardware and Component Specifications

System Component Configuration
Supermicro X12 Gaudi Training Nodes
CPU Type Intel Xeon Gold 6336
Habana Gaudi processors 336
Nodes 42
Training processors/Node 8
Host x86 processors/node 2
Sockets 2
Memory capacity

* 512 GB DDR4 DRAM

Memory/training processor

32 GB HDM2

Local Storage

6.4 TB local NVMe

Max CPU Memory bandwidth ** GB/s
Intel First Generation Habana Inference Nodes
CPU Type Xeon Gold 6240
First-Generation Habana Inference Processors 16
Nodes 2
First-Generation Habana Inference Cards/node 8
Cores/socket 20
Sockets 2
Clock speed 2.5 GHz
Flop speed 34.4 TFlop/s
Memory capacity *384 GB DDR4 DRAM
Local Storage

1.6TB Samsung PM1745b NVMe PCIe SSD

Max CPU Memory bandwidth 281.6 GB/s
Standard Compute Nodes
CPU Type Intelx86
Nodes 36
x86 processors/node 2
Memory Capacity 384 GB
Local NVMe 3.2 TB
 Interconnect
Topology Full bi-section bandwidth switch
Per Node bandwidth 6*400 Gb/s (bidirectional)
DISK I/O Subsystem
File Systems  Ceph
Ceph Storage 1 PB

Voyager