Discoverer

Discoverer featured image

System Overview

  • Name: Discoverer Petascale Supercomputer
  • Location: Bulgaria
  • Owner: Consortium Petascale Supercomputer - Bulgaria
  • Operator: Sofia Tech Park JSC (SofiaTech)
  • Released in: 2021
  • Primary focus area: Applications

Architecture and Performance


Aggregated computational resources System Performance CPU PARTITION:

144384 hardware cores
288768 logical CPUs
295 TB RAM

Compute nodes:

1128 compute nodes

1110 “regular” nodes

18 “fat” nodes

Each compute node is equipped with:

CPU: 2 x AMD EPYC 7H12 64-Core Processor (Sockets 8, CoresPerSocket 16, ThreadsPerCore 2)

RAM:

per “regular” node: 256 GB (Micron Technology Inc. DDR4, 3200 MT/s, 16 x 16 GB)

per “fat” node: 1 TB (Micron Technology Inc. DDR4, 3200 MT/s, 16 x 64 GB)

Ethernet: 2 x 1000BASE-T, 100BASE-TX, 10BASE-T Intel® Ethernet Controller I350

Infiniband: Mellanox Technologies MT28908 Family [ConnectX-6], 1 x 200Gb/s

The entire system is backed up against a power failure using an uninterruptible power supply with an output of 1 MW. The operating system that the machine runs on is Red Hat Enterprise Linux 8.


Aggregated computational resources System Performance GPU PARTIOTION:

4 X NVIDIA DGX H200

NVIDIA DGX H200 Specifications:

GPU: 8x NVIDIA H200 Tensor Core GPUs, with 141GB of GPU memory each

GPU memory 1: 128GB total Performance 32 petaFLOPS FP8

NVIDIA NVSwitch™ 4x

System power usage: 10.2kW max

CPU Dual Intel® Xeon® Platinum 8480C Processors: 112 Cores total, 2.00 GHz (Base), 3.80 GHz (Max Boost)

System memory: 2TB

Networking: 4x OSFP ports serving 8x single-port NVIDIA

ConnectX-7 VPI:
> Up to 400Gb/s InfiniBand/Ethernet

2x dual-port QSFP112 NVIDIA ConnectX-7 VPI:
> Up to 400Gb/s InfiniBand/Ethernet

Management network: 10Gb/s onboard NIC with RJ45, 100Gb/s Ethernet NIC

Host baseboard management controller: (BMC) with RJ45

Storage OS: 2x 1.92TB NVMe M.2

Internal storage: 8x 3.84TB NVMe U.2


System Performance:

DISCOVERER is a Petascale supercomputer capable of executing 4.5 petaFLOPS Rmax and over 6 petaFLOPS Rpeak.

Achievements and Impact

Rankings & Records:

With these computing capabilities, Discoverer was ranked 91st in the world at the time of its launch in 2021, while the 2024 rankings place the machine at 224th place.

Scientific Contributions:

In-silico Drug Discovery
Structure-Property Predictions & Molecular Discovery
Digital Product Formulation & Optimization
Climate & Weather Forecasting / Environmental Modelling
Simulated Environments in Automotive & Civil Engineering
FinTech/MarkeTech & Big Data (DL/ML/AI)

Sustainability and Future Outlook

The Discoverer supercomputer is designed with energy-efficient technologies, including advanced cooling systems, to optimize performance while reducing energy consumption. Future upgrades include the integration of next-generation hardware, such as NVIDIA H200 GPUs and expanded storage, to enhance computational power and efficiency. There is also a strong focus on advancing AI/ML capabilities to tackle complex challenges in areas like climate modeling, healthcare, and materials science. These developments will ensure that Discoverer remains at the forefront of high-performance computing innovation. For more details, visit here: www.discoverer.bg

Contact Information