• Welcome to TechPowerUp Forums, Guest! Please check out our forum guidelines for info related to our community.

Atos to Build Max Planck Society's new BullSequana XH3000-based Supercomputer, Powered by AMD MI300 APU

AleksandarK

News Editor
Staff member
Joined
Aug 19, 2017
Messages
2,591 (0.97/day)
Atos today announces a contract to build and install a new high-performance computer for the Max Planck Society, a world-leading science and technology research organization. The new system will be based on Atos' latest BullSequana XH3000 platform, which is powered by AMD EPYC CPUs and Instinct accelerators. In its final configuration, the application performance will be three times higher than the current "Cobra" system, which is also based on Atos technologies.

The new supercomputer, with a total order value of over 20 million euros, will be operated by the Max Planck Computing and Data Facility (MPCDF) in Garching near Munich and will provide high-performance computing (HPC) capacity for many institutes of the Max Planck Society. Particularly demanding scientific projects, such as those in astrophysics, life science research, materials research, plasma physics, and AI will benefit from the high-performance capabilities of the new system.




The system will run without fans thanks to its unmatched hot water cooling (Direct Liquid Cooling) and thus have a significantly improved energy efficiency. The efficiency gained from this Atos' cooling system matched with the latest in silicon architecture innovations from AMD, designed with energy efficiency in mind, brings the Power Usage Effectiveness (PUE) value to less than 1.05 (1 being the ideal ratio), far below the average of other HPC installations.

The installation will feature 4th Gen AMD EPYC processors and for the first time in an Atos-based European system, the upcoming AMD Instinct MI300A accelerator. The system will consist of ten BullSequana XH3000 racks with a total of 768 processor nodes of and 192 accelerator nodes and will be complemented with an IBM SpectrumScale storage solution. The CPU nodes will be delivered in the third quarter of 2023, with full installation of the GPU nodes expected in the first half of 2024.

Prof. Erwin Laure, Director of the Max Planck Computing and Data Facility said "The computing power required by scientific research is ever increasing and we see an unabated need for high-performance computing capacity. We want to provide the best possible support to our researchers in their work and have therefore decided to modernize our high-performance computing complex. With Atos and AMD, we have the right partners for this. The new solution will certainly meet our demands and once again advance science in leaps and bounds."

Emmanuel Le Roux, Group SVP, Global Head of HPC, AI & Quantum at Atos, highlighted, "We are very proud to have been awarded this contract and to have been trusted with our extensive HPC expertise. We are convinced that the combination of our newly developed, powerful and energy-efficient BullSequana XH3000 system with the high-performance AMD Instinct MI300A processors will provide the Max Planck Society with a future-proof system and the computing power required to further continue its ground-breaking research."

Brad McCredie, corporate vice president, Data Center Acceleration Business, AMD said "AMD, with the MI300A APU, continues to deliver breakthrough performance for researchers and the high performance computing industry. AMD is excited by the strong market validation of the performance, power and simplified programming advantages unlocked by the MI300A APU architecture and we are looking forward to working with Atos to advance the specific science and research needs of the Max Planck Society."

View at TechPowerUp Main Site
 
Joined
Dec 12, 2016
Messages
1,846 (0.63/day)
Thank goodness, Germany is giving Intel a lot of money to help build these kind of European supercomputers. Oh wait…
 

Count von Schwalbe

Moderator
Staff member
Joined
Nov 15, 2021
Messages
3,085 (2.78/day)
Location
Knoxville, TN, USA
System Name Work Computer | Unfinished Computer
Processor Core i7-6700 | Ryzen 5 5600X
Motherboard Dell Q170 | Gigabyte Aorus Elite Wi-Fi
Cooling A fan? | Truly Custom Loop
Memory 4x4GB Crucial 2133 C17 | 4x8GB Corsair Vengeance RGB 3600 C26
Video Card(s) Dell Radeon R7 450 | RTX 2080 Ti FE
Storage Crucial BX500 2TB | TBD
Display(s) 3x LG QHD 32" GSM5B96 | TBD
Case Dell | Heavily Modified Phanteks P400
Power Supply Dell TFX Non-standard | EVGA BQ 650W
Mouse Monster No-Name $7 Gaming Mouse| TBD
What kind of performance levels are we looking at? TOP500 worthy?
 
Joined
Jan 5, 2006
Messages
18,584 (2.69/day)
System Name AlderLake
Processor Intel i7 12700K P-Cores @ 5Ghz
Motherboard Gigabyte Z690 Aorus Master
Cooling Noctua NH-U12A 2 fans + Thermal Grizzly Kryonaut Extreme + 5 case fans
Memory 32GB DDR5 Corsair Dominator Platinum RGB 6000MT/s CL36
Video Card(s) MSI RTX 2070 Super Gaming X Trio
Storage Samsung 980 Pro 1TB + 970 Evo 500GB + 850 Pro 512GB + 860 Evo 1TB x2
Display(s) 23.8" Dell S2417DG 165Hz G-Sync 1440p
Case Be quiet! Silent Base 600 - Window
Audio Device(s) Panasonic SA-PMX94 / Realtek onboard + B&O speaker system / Harman Kardon Go + Play / Logitech G533
Power Supply Seasonic Focus Plus Gold 750W
Mouse Logitech MX Anywhere 2 Laser wireless
Keyboard RAPOO E9270P Black 5GHz wireless
Software Windows 11
Benchmark Scores Cinebench R23 (Single Core) 1936 @ stock Cinebench R23 (Multi Core) 23006 @ stock
Joined
Sep 1, 2020
Messages
2,353 (1.52/day)
Location
Bulgaria
The machine is small budget facility. 20 vs 600* millions.

*Today price for exaflop supercomputer like Frontier.
 

Space Lynx

Astronaut
Joined
Oct 17, 2014
Messages
17,262 (4.67/day)
Location
Kepler-186f
Processor 7800X3D -25 all core ($196)
Motherboard B650 Steel Legend ($179)
Cooling Frost Commander 140 ($42)
Memory 32gb ddr5 (2x16) cl 30 6000 ($80)
Video Card(s) Merc 310 7900 XT @3100 core $(705)
Display(s) Agon 27" QD-OLED Glossy 240hz 1440p ($399)
Case NZXT H710 (Red/Black) ($60)
this is pretty cool to see, I hope it ends up benefiting mankind in one way or another
 

HTC

Joined
Apr 1, 2008
Messages
4,664 (0.77/day)
Location
Portugal
System Name HTC's System
Processor Ryzen 5 5800X3D
Motherboard Asrock Taichi X370
Cooling NH-C14, with the AM4 mounting kit
Memory G.Skill Kit 16GB DDR4 F4 - 3200 C16D - 16 GTZB
Video Card(s) Sapphire Pulse 6600 8 GB
Storage 1 Samsung NVMe 960 EVO 250 GB + 1 3.5" Seagate IronWolf Pro 6TB 7200RPM 256MB SATA III
Display(s) LG 27UD58
Case Fractal Design Define R6 USB-C
Audio Device(s) Onboard
Power Supply Corsair TX 850M 80+ Gold
Mouse Razer Deathadder Elite
Software Ubuntu 20.04.6 LTS
You'll see Planck's Constant like you've never seen it before ... perhaps even ray-traced ...
 
Joined
Apr 24, 2020
Messages
2,710 (1.61/day)
The installation will feature 4th Gen AMD EPYC processors and for the first time in an Atos-based European system, the upcoming AMD Instinct MI300A accelerator. The system will consist of ten BullSequana XH3000 racks with a total of 768 processor nodes of and 192 accelerator nodes and will be complemented with an IBM SpectrumScale storage solution. The CPU nodes will be delivered in the third quarter of 2023, with full installation of the GPU nodes expected in the first half of 2024.

Weird setup. So 768 CPU-nodes + 192 CPU+GPU-nodes ??

I've heard of all-CPU designs, and all-GPU designs. But this is a weird hybrid between the two.
 
Joined
Apr 24, 2020
Messages
2,710 (1.61/day)
Just read about AMD MI300.

I know how the APU works.

Its just weird to me to have.... what is effectively two different supercomputers hooked up and networked together. Normally, a supercomputer has the "same node" design across the entire supercomputer, so that there is less to study / easier to understand to code against.

There's a 768-pure CPU cluster + the 192-node CPU+GPU (probably MI300) cluster. A strange design and a headache to load balance against.
 
Joined
May 9, 2012
Messages
8,527 (1.86/day)
Location
Ovronnaz, Wallis, Switzerland
System Name main/SFFHTPCARGH!(tm)/Xiaomi Mi TV Stick/Samsung Galaxy S23/Ally
Processor Ryzen 7 5800X3D/i7-3770/S905X/Snapdragon 8 Gen 2/Ryzen Z1 Extreme
Motherboard MSI MAG B550 Tomahawk/HP SFF Q77 Express/uh?/uh?/Asus
Cooling Enermax ETS-T50 Axe aRGB /basic HP HSF /errr.../oh! liqui..wait, no:sizable vapor chamber/a nice one
Memory 64gb DDR4 3600/8gb DDR3 1600/2gbLPDDR3/8gbLPDDR5x/16gb(10 sys)LPDDR5 6400
Video Card(s) Hellhound Spectral White RX 7900 XTX 24gb/GT 730/Mali 450MP5/Adreno 740/Radeon 780M 6gb LPDDR5
Storage 250gb870EVO/500gb860EVO/2tbSandisk/NVMe2tb+1tb/4tbextreme V2/1TB Arion/500gb/8gb/256gb/4tb SN850X
Display(s) X58222 32" 2880x1620/32"FHDTV/273E3LHSB 27" 1920x1080/6.67"/AMOLED 2X panel FHD+120hz/7" FHD 120hz
Case Cougar Panzer Max/Elite 8300 SFF/None/back/back-front Gorilla Glass Victus 2+ UAG Monarch Carbon
Audio Device(s) Logi Z333/SB Audigy RX/HDMI/HDMI/Dolby Atmos/KZ x HBB PR2/Moondrop Chu II + TRN BT20S
Power Supply Chieftec Proton BDF-1000C /HP 240w/12v 1.5A/4Smart Voltplug PD 30W/Asus USB-C 65W
Mouse Speedlink Sovos Vertical-Asus ROG Spatha-Logi Ergo M575/Xiaomi XMRM-006/touch/touch
Keyboard Endorfy Thock 75% <3/none/touch/virtual
VR HMD Medion Erazer
Software Win10 64/Win8.1 64/Android TV 8.1/Android 13/Win11 64
Benchmark Scores bench...mark? i do leave mark on bench sometime, to remember which one is the most comfortable. :o
But the MI300 can't run cuda!
well... yeah it can't run proprietary standard ... but open one ... yes? ;)

CUDA is nice but too closed imho, at least OpenCL can run on CPU too ... :D
 
Joined
Apr 24, 2020
Messages
2,710 (1.61/day)
well... yeah it can't run proprietary standard ... but open one ... yes? ;)

CUDA is nice but too closed imho, at least OpenCL can run on CPU too ... :D

I honestly don't think any of the major GPU manufacturers are advancing OpenCL today. Last time I checked, only OpenCL1.2 was well supported on anybody. OpenCL 2.0 never functioned well and OpenCL 3.0 hasn't made much buzz.

NVidia is pushing CUDA. AMD is pushing ROCm / HIP specifically. Intel is pushing OneAPI / SyCL.

Supercomputers have a lot of Fortran, and OpenMP code. There are efforts to port this code over to GPUs, and that's my overall expectation for how things would work in the Supercomputer world. If specific AMD code needs to be written, I'd expect ROCm to be leveraged on this particular supercomputer. (Similarly, CUDA would be used on NVidia-specific supercomputers if portability doesn't matter to that particular team). But I'm not in the supercomputer field at all actually, just passing some rumors / hearsay.
 
Joined
May 9, 2012
Messages
8,527 (1.86/day)
Location
Ovronnaz, Wallis, Switzerland
System Name main/SFFHTPCARGH!(tm)/Xiaomi Mi TV Stick/Samsung Galaxy S23/Ally
Processor Ryzen 7 5800X3D/i7-3770/S905X/Snapdragon 8 Gen 2/Ryzen Z1 Extreme
Motherboard MSI MAG B550 Tomahawk/HP SFF Q77 Express/uh?/uh?/Asus
Cooling Enermax ETS-T50 Axe aRGB /basic HP HSF /errr.../oh! liqui..wait, no:sizable vapor chamber/a nice one
Memory 64gb DDR4 3600/8gb DDR3 1600/2gbLPDDR3/8gbLPDDR5x/16gb(10 sys)LPDDR5 6400
Video Card(s) Hellhound Spectral White RX 7900 XTX 24gb/GT 730/Mali 450MP5/Adreno 740/Radeon 780M 6gb LPDDR5
Storage 250gb870EVO/500gb860EVO/2tbSandisk/NVMe2tb+1tb/4tbextreme V2/1TB Arion/500gb/8gb/256gb/4tb SN850X
Display(s) X58222 32" 2880x1620/32"FHDTV/273E3LHSB 27" 1920x1080/6.67"/AMOLED 2X panel FHD+120hz/7" FHD 120hz
Case Cougar Panzer Max/Elite 8300 SFF/None/back/back-front Gorilla Glass Victus 2+ UAG Monarch Carbon
Audio Device(s) Logi Z333/SB Audigy RX/HDMI/HDMI/Dolby Atmos/KZ x HBB PR2/Moondrop Chu II + TRN BT20S
Power Supply Chieftec Proton BDF-1000C /HP 240w/12v 1.5A/4Smart Voltplug PD 30W/Asus USB-C 65W
Mouse Speedlink Sovos Vertical-Asus ROG Spatha-Logi Ergo M575/Xiaomi XMRM-006/touch/touch
Keyboard Endorfy Thock 75% <3/none/touch/virtual
VR HMD Medion Erazer
Software Win10 64/Win8.1 64/Android TV 8.1/Android 13/Win11 64
Benchmark Scores bench...mark? i do leave mark on bench sometime, to remember which one is the most comfortable. :o
I honestly don't think any of the major GPU manufacturers are advancing OpenCL today. Last time I checked, only OpenCL1.2 was well supported on anybody. OpenCL 2.0 never functioned well and OpenCL 3.0 hasn't made much buzz.

NVidia is pushing CUDA. AMD is pushing ROCm / HIP specifically. Intel is pushing OneAPI / SyCL.

Supercomputers have a lot of Fortran, and OpenMP code. There are efforts to port this code over to GPUs, and that's my overall expectation for how things would work in the Supercomputer world. If specific AMD code needs to be written, I'd expect ROCm to be leveraged on this particular supercomputer. (Similarly, CUDA would be used on NVidia-specific supercomputers if portability doesn't matter to that particular team). But I'm not in the supercomputer field at all actually, just passing some rumors / hearsay.
yep... sadly they aren't interested in pushing one open standard for the good of all ... oh, well ... hilarious that OpenCL is open .... after all it's Khronos (not a problem... they are open) and ... Apple
(CPU are OpenCL1 1.2 at max, iirc, which explain what you mention)
anyhow, as long as they have API to run the things ... be it OpenCL or anything else ... and the performances are there : yep, all is good.

Sheesh, it was a joke. I couldn't care less what it runs, not in my budget.
Crysis is the usual joke in that case ... :D
 
Joined
Mar 10, 2010
Messages
11,878 (2.21/day)
Location
Manchester uk
System Name RyzenGtEvo/ Asus strix scar II
Processor Amd R5 5900X/ Intel 8750H
Motherboard Crosshair hero8 impact/Asus
Cooling 360EK extreme rad+ 360$EK slim all push, cpu ek suprim Gpu full cover all EK
Memory Corsair Vengeance Rgb pro 3600cas14 16Gb in four sticks./16Gb/16GB
Video Card(s) Powercolour RX7900XT Reference/Rtx 2060
Storage Silicon power 2TB nvme/8Tb external/1Tb samsung Evo nvme 2Tb sata ssd/1Tb nvme
Display(s) Samsung UAE28"850R 4k freesync.dell shiter
Case Lianli 011 dynamic/strix scar2
Audio Device(s) Xfi creative 7.1 on board ,Yamaha dts av setup, corsair void pro headset
Power Supply corsair 1200Hxi/Asus stock
Mouse Roccat Kova/ Logitech G wireless
Keyboard Roccat Aimo 120
VR HMD Oculus rift
Software Win 10 Pro
Benchmark Scores 8726 vega 3dmark timespy/ laptop Timespy 6506
yep... sadly they aren't interested in pushing one open standard for the good of all ... oh, well ... hilarious that OpenCL is open .... after all it's Khronos (not a problem... they are open) and ... Apple
(CPU are OpenCL1 1.2 at max, iirc, which explain what you mention)
anyhow, as long as they have API to run the things ... be it OpenCL or anything else ... and the performances are there : yep, all is good.


Crysis is the usual joke in that case ... :D
Probably not got the RT chops for remastered Crysis yeah but can it play crisis mode, what does:p.
 

Count von Schwalbe

Moderator
Staff member
Joined
Nov 15, 2021
Messages
3,085 (2.78/day)
Location
Knoxville, TN, USA
System Name Work Computer | Unfinished Computer
Processor Core i7-6700 | Ryzen 5 5600X
Motherboard Dell Q170 | Gigabyte Aorus Elite Wi-Fi
Cooling A fan? | Truly Custom Loop
Memory 4x4GB Crucial 2133 C17 | 4x8GB Corsair Vengeance RGB 3600 C26
Video Card(s) Dell Radeon R7 450 | RTX 2080 Ti FE
Storage Crucial BX500 2TB | TBD
Display(s) 3x LG QHD 32" GSM5B96 | TBD
Case Dell | Heavily Modified Phanteks P400
Power Supply Dell TFX Non-standard | EVGA BQ 650W
Mouse Monster No-Name $7 Gaming Mouse| TBD
Probably not got the RT chops for remastered Crysis yeah but can it play crisis mode, what does:p.
It's got the compute power to run it at higher FPS than what a standard computer can, but the latency would be much less than ideal.
 
Top