getting ready for dual 5090, Functional protype on dual 4090

[venturi]

Well,

I had forgotten to post the upgrade I did about a year ago, now I'm getting ready for dual 5090. So I figured I'd show the barebones of the system minus the mesh face.

Core Specs:
2x 4090 RTX Founders Edition
2x AMD 7773x Epyc (128/256 cores), Gigabyte MZ72-HB0 Dual socket motherboard
1 TB RAM DDR4 ECC LRDIMMs 1600W+ digital power supply
(Data drive) Raid 0 Micron 9300 Max (15.4TB each / 77TB array - overprovisioned to 64TB)
(OS Drive) Sabrent Rocket 4 Plus (8TB). 2x Back up drives Micron 5300 8TB each
Asus PA32UCG-K monitor, MS Data Center 2022 & Ubuntu, Air cooled, cool temps, relatively small case

Some perfs:
data write speeds in excess of 50.6 Gb/s

Video Benchmarks (fist place)

GravityMark Leaderboard

GravityMark GPU Benchmark

gravitymark.tellusim.com

What's different about this build (other than the specs)?

1. All air cooled
2. So quiet, you won't find it in the room with your eyes shut
3. Runs very cool temps: video cards under load and benchmarks don't exceed 48C, CPUs under load don't exceed 46C, normal operation is about—-> 24C for CPUs and 31C for video cards.
4. Dual video cards are inverted so warm air is directed away from CPUs and motherboard, everything stays frosty. room temps in our house are normally 69-71F
5. Open design
6. Dual Epic board with Resizable BAR

What's is its purpose:
Personal PC for doing school work, dialing into work on occasion, emails, surfing web, doing some AI CNN NLM for medical, and gaming at maximum resolution with all eye candy on.



Some reveal pics:

Questions?


J

 

[bonehead123]

For the uses you listed, overkill does not even come close to describing the machine you have now, even before you add 2x 5090's into the equation....

Just curious why you would spend so much $$ on so much hardware that you will rarely, if ever, fully utilize to it's max capabilities....and please don't say "future proofing" which we all know is a mythological/non-existent creature at best...and a soul-sucking bottomless pit at worst....

Oh do tell please

 

[Denver]

Everything in this post is beyond my comprehension. From the use mentioned to the fact that a 1600w power supply can handle all this hardware without disarming throws me into a black box of confusion that I can't find a way out of. lol

But anyway...Great build, I hope Chrome doesn't run out of memory. :')

 

[wolf]

I can't even. Congratulations? what do you say to the person who has it all...

 

[venturi]

For the uses you listed, overkill does not even come close to describing the machine you have now, even before you add 2x 5090's into the equation....

Just curious why you would spend so much $$ on so much hardware that you will rarely, if ever, fully utilize to it's max capabilities....and please don't say "future proofing" which we all know is a mythological/non-existent creature at best...and a soul-sucking bottomless pit at worst....

Oh do tell please

Well, it does really well on CNN and it helped wrap up my doctorate,
it was cheaper to do it this way than spend on the pro cards from nvidia. The cpus were bought on eBay for a fraction of the cost (new oem) etc

for some CNN, algorithms, training data, etc, I can run out if resources very fast.

J

 

[Dr. Dro]

Hey hey, always a great thread when you come around. Sweet to see another excellent build from you, man. What came of your old Xeon Platinums?

 

[JWNoctis]

It's almost amazing how fast VRAM could run short while doing ML work. As expensive as 4090 is, it pales in comparison to things like the RTX 6000 Ada.

That 2xEpyc setup is absolutely...legendary. (Sorry )

What kind of memory bandwidth do you see with this setup?

 

[freeagent]

Pretty sick man!

As you can tell, there is some hardware envy going on here

 

[venturi]

Hey hey, always a great thread when you come around. Sweet to see another excellent build from you, man. What came of your old Xeon Platinums?

I still have them in a box, have not decided what to do with them, including the ram

It's almost amazing how fast VRAM could run short while doing ML work. As expensive as 4090 is, it pales in comparison to things like the RTX 6000 Ada.

That 2xEpyc setup is absolutely...legendary. (Sorry )

What kind of memory bandwidth do you see with this setup?

I have not benched the memory, but suppose I could

Evening glow:

 

[ir_cow]

Beefy

Everything in this post is beyond my comprehension. From the use mentioned to the fact that a 1600w power supply can handle all this hardware without disarming throws me into a black box of confusion that I can't find a way out of. lol

I saw 4x 4090s on a single 1600 at CES. It broke me as well.

 

[freeagent]

Honestly.. if it were me..

I wouldn't have it on the floor.

I would get an end table or something

 

[Dr. Dro]

Honestly.. if it were me..

I wouldn't have it on the floor.

I would get an end table or something

The floor's probably the safest place to have it, all things considered. I have mine beside my main desk on a bar stand, lol. But my bench is nowhere near as fancy!

 

[Toothless]

The man with my dream builds strikes again! Partially responsible on why I still run dual sockets.

 

[Double-Click]

Honestly.. if it were me..

I wouldn't have it on the floor.

I would get an end table or something

End table with guard rails, pillow moat and an insurance policy.

 

[venturi]

Beefy


I saw 4x 4090s on a single 1600 at CES. It broke me as well.

the ax1600i has a built in utility that lets you manage single rail multi rail on the fly and set parameters . So when I monitor performance under heavy load, multiple overlapping roles such as running Hellblade 2, cyberpunk bench and two vms open, - or when I run gravity mark across both video cards at max with millions of asteroids and AFR CU the max it hit peak reported was 1170w

if I deliberately write an algorithm to hammer ram, cpus, and video (not a realistic setting) I was able to peak at 1310w, but that is not a real case scenario


with that said, I built it so if I need to I can add another ax1600i or a pair of Hela 2050R psus
I had the sockets in that room were wired to the breaker to handle it if

but for now, I”m not near a concern / limit

for now…

 

[Legacy Ivy Terascale]

dont count the chicks before the eggs will hatch
could be cancelled like the 4080 Ti , 4080 12 GB or 4090 Ti

 

[Ruru]

I can't even imagine how many hot AI chicks I would make with that setup (my avatar's been made with a RTX 6000)

 

[Legacy Ivy Terascale]

I can't even imagine how many hot AI chicks I would make with that setup (my avatar's been made with a RTX 6000)

i thought you photographed a friend or a relative
now i took a closer look and she looks real

 

[sepheronx]

I'm an idiot

How do you connect all those U.2 drives to the mobo?

 

[Onasi]

I actually don’t even care about the hardware. I am far more interested in that chair. What is that? Looks rather comfy.

 

[Super Firm Tofu]

I'm an idiot

How do you connect all those U.2 drives to the mobo?

I would assume to the SlimSAS ports.

 

[Toothless]

I actually don’t even care about the hardware. I am far more interested in that chair. What is that? Looks rather comfy.

I'm here for both. My last chair pulled something in my leg which ruined my streak of being pain free.

 

[oxrufiioxo]

Def one of my favorite thread makers on TPU builds always look like what I would do if I had unlimited money

I see you swapped to Epyc cpus how is that going vs when you were running Xeon Platinum's I believe

 

[natr0n]

Lavish rig

 

[venturi]

I actually don’t even care about the hardware. I am far more interested in that chair. What is that? Looks rather comfy.

Its by Iron Horse, its their 24 hour chair control room chair

Def one of my favorite thread makers on TPU builds always look like what I would do if I had unlimited money

I see you swapped to Epyc cpus how is that going vs when you were running Xeon Platinum's I believe

There an improvement, there were challenges and opportunities in the build. There were challenges and opportunities in moving from intel to AMD. I would characterize it as AMD motherboad makers are a little rough around the edges. This board in some respects was barebones compared to the asus dual sage motherboard I had.

Is it faster, deeper and more powerful - yes, even the benches show that. However I would not say it was by any wide margin.

I'm an idiot

How do you connect all those U.2 drives to the mobo?

Like SuperFirmTufu said, using the 5 SaS connectors on the board