• Welcome to TechPowerUp Forums, Guest! Please check out our forum guidelines for info related to our community.

Turn a Dell Poweredge T630 into a rendering farm !

Joined
Oct 24, 2004
Messages
1,294 (0.18/day)
Hello,

This summer has been pretty calm, until my brother came to me with a special request : He heard i got hold of a retired (yet fully functionnal) Dell Poweredge T630 at work, and since i couldn’t do what i wanted with it, we decided to transform it into a rendering server for his company.

The goal is to invest in a powerfull production tool, in order to become completely autonomous and self-sufficient to render their own Cinema4D / Optane creations :



« Bonjour Lab is an interactive visual creation studio that aims to design and produce new storytelling approaches.

Since 2013, we blend cutting edge technology and visual poetry to deliver tailor made, limitless, creative experiences.

Experts in new visual production techniques, at the forefront of technological innovation and the design of immersive spaces, we conceive and craft innovative and meaningful experiences and places.

Our expertise ranges from real time data driven interactive creations, to the design of immersive spaces and large scale media art. We work for company headquarters, showrooms, exhibition fairs, malls, flagships, brand events and cultural performances and institutions.

We advise about technologies and visual tendencies that would fit communication objectives. We create new visual designs daily to imagine new narratives that emphasize the brand’s message. We are always searching for new technologies to combine and integrate in new kinds of experiences. We conceive and create in an arts and crafts manner to best fit our clients’ needs. »


Please take a look at their showcase website, you will see some truely unique and impressive visual creations, they will speak more than a thousand words ! : https://www.bonjour-lab.com/

Here are the specs :

- 2 x Intel Xeon E5 2630 V3 (a total of 16 cores / 32HT @2,4Ghz / 40MB L3 cache)
- 2 x 32Gb DDR4 PC2400 Registered
- 2 x Dell PSU Platinum 1100W each
- 2 x MSI Geforce RTX 2070 super OC GP (soon to become 4 of them)
- 2 x Kingston 128Gb set in RAID1 for the operating system
- 2 x Crucial BX500 2TB each to store the assets and the renderered scenes

Additionnal parts required to power this beast and to cool it decently :
- Dell GPU enablement kit ( 4 x 8pins to 8Pins+6pins power adapter cables)
- Dell GPU fan kit (4 additional fans)



Here’s the server :

1597329409228.png
1597329425044.png




There’s a lot of room in this case, you can shove up to 1536GB of RAM across all 24 RAM slots, that’s 768Gb per CPU.

Since we did not win at the lottery recently, we will be content with those 2 sticks of 32GB PC2400 registered DDR4.

Dell suggest to populate the white slots first, so that's what we did with our 2 sticks :

1597329465044.png




This motherboard can handle 4 x PCI 3.0 graphic cards, so we will start with 2 MSI Geforce RTX 2070 Ventus OC GP :

1597329498218.png




Populating 2 PCI-E slot with our first 2 GPUs comes at a price : we had to drop the original 2 x 717W PSUs in favor of 2 x 1100W Platinum PSUs, since it's the recommended configuration according with the Dell user's manual.

They will be mandatory when the server later grows to 4 GPUs anyway :

1597329607642.png
1597329622081.png




The server came equipped with 2 redundants and hot swappables system cooling fans. They are extremely powerfull and consequently very noisy, thats why i did my homework and found a way to disable dynamic speed shifting, in order to impose a set speed for everyday's use (before becoming deaf !) This involves some light scripting and the use of the embedded iDRAC controller (more later if you are interested).

1597329680509.png
1597329693606.png




Each CPU is cooled with what look like a fairly generic blocks of aluminium with fins :

1597329911003.png





Luckily, the cooling shroud has aerodynamically placed openings that direct the airflow across the entire system. The airflow passes through all the critical parts of the system, where the vacuum pulls air across the entire surface area of the heat sink, thus allowing increased cooling.

1597329981362.png


[--- end of 1rst part, thanks for watching this thread !! -----]
 
Last edited:

phill

Moderator
Staff member
Joined
Jun 8, 2011
Messages
17,049 (3.43/day)
Location
Somerset, UK
System Name Not so complete or overkill - There are others!! Just no room to put! :D
Processor Ryzen Threadripper 3970X
Motherboard Asus Zenith 2 Extreme Alpha
Cooling Lots!! Dual GTX 560 rads with D5 pumps for each rad. One rad for each component
Memory Viper Steel 4 x 16GB DDR4 3600MHz not sure on the timings... Probably still at 2667!! :(
Video Card(s) Asus Strix 3090 with front and rear active full cover water blocks
Storage I'm bound to forget something here - 250GB OS, 2 x 1TB NVME, 2 x 1TB SSD, 4TB SSD, 2 x 8TB HD etc...
Display(s) 3 x Dell 27" S2721DGFA @ 7680 x 1440P @ 144Hz or 165Hz - working on it!!
Case The big Thermaltake that looks like a Case Mods
Audio Device(s) Onboard
Power Supply EVGA 1600W T2
Mouse Corsair thingy
Keyboard Razer something or other....
VR HMD No headset yet
Software Windows 11 OS... Not a fan!!
Benchmark Scores I've actually never benched it!! Too busy with WCG and FAH and not gaming! :( :( Not OC'd it!! :(
So nice to see you posting @blobster21 !! :D :D

It looks like it will be a beast of a system... Can't wait to see it unfold :D :D

DDR4 registered RAM is a pain to find and I know the issues with buying more of the ram.. It ain't cheap!!

Can't wait to see more of the build!! Can you team it up with some R710's at all?? :D
 
Joined
Oct 24, 2004
Messages
1,294 (0.18/day)
Hi @phill !

I have been putting the 2 x R710 to good use during the home confinement up until now (eventhough i could not use them as i first intended for the TechPowerUp! WCG team)

Both are lovely, and remarkably quiet once you send the appropriate raw hex values to the Intelligent Plateform Management Interface (aka IPMI).

I'll catch up later this year, when my room temp goes below 28°C, and will start crunching again soon.

For now, both servers are living a peacefull life in a 6U open chassis near me :



Anyway, back to this rendering server project log, since i finally received the most important part of the server : the GPU enablement kit (a 4 ways power splitter daughter board, and 4 x 8pins to 8pins + 6 Pins GPU power cables)

I took a picture of the motherboard for quick reference, just to make sure i would be able to put everything back into place after this hardware upgrade :



then I proceeded to unscrew all mounting screws, remove all centering studs from the motherboard to set it completely free, and finally unplug all motherboard cables, in order to reach the power circuitry hidden under the motherboard tray :



All i had to do was to plug the daughter board into the place provided for this purpose:



Then attach all 4 power cables to feed 4 hungry GPUs:



Putting back everything into place was rather easy, then i put the cooling shroud over both Heatsinks, insert both hot swappable chassis fans, and proceeded to plug 2 GPU into the server: the first one in the first PCI 3.0 slot, and the second card in the third PCI 3.0 slot



But there was NO WAY i could properly close the side panel anymore : the power cables of the newly installed GPU on the upper PCI-E slot would bump against the locking mechanism ! Hopefully, moving the GPU to the second PCI 3.0 slot did the trick, but there's a downside to this : the GPU is almost touching the RAID controller, and those PERC H730 cards can run pretty hot, adding even more heat to an already extremely hot GPU card. But it's not like i had much choice so i settled for this setup :



I will have to give it a good thinking again otherwise i will never be able to add 2 more GPUs in the future (i'm already looking for some angled 8pins + 6pins adapters i could use in this server, if you guys know some brands and shops where to buy them in the EU, it would be pretty much appreciated)

On a side note : i thought i could use those 2 anti-saging support brackets which came with the server, unfortunately both RTX 2070 super are too bulky and the brackets won't fit anymore.



They were most likely designed to support quadro / nvs cards which are thinner than the one i put in the server. Well nevermind that :)

That's it for this second update, i will post more soon, as there is one last piece of hardware to put in the server in order to cool it adequately : a massive 4 fans cooling rack i ordered on ebay a couple weeks ago. Teaser : those 4 suckers can work at any given speed between 1200 and 12000 RPM when they are set to maximum speed :eek:o_O

Thanks for watching this thread !
 
Last edited:
Joined
Mar 23, 2016
Messages
4,844 (1.50/day)
Processor Core i7-13700
Motherboard MSI Z790 Gaming Plus WiFi
Cooling Cooler Master RGB something
Memory Corsair DDR5-6000 small OC to 6200
Video Card(s) XFX Speedster SWFT309 AMD Radeon RX 6700 XT CORE Gaming
Storage 970 EVO NVMe M.2 500GB,,WD850N 2TB
Display(s) Samsung 28” 4K monitor
Case Phantek Eclipse P400S
Audio Device(s) EVGA NU Audio
Power Supply EVGA 850 BQ
Mouse Logitech G502 Hero
Keyboard Logitech G G413 Silver
Software Windows 11 Professional v23H2
It didn’t click at first where I’ve seen the two Dell server’s before. There from you @phill?
 

phill

Moderator
Staff member
Joined
Jun 8, 2011
Messages
17,049 (3.43/day)
Location
Somerset, UK
System Name Not so complete or overkill - There are others!! Just no room to put! :D
Processor Ryzen Threadripper 3970X
Motherboard Asus Zenith 2 Extreme Alpha
Cooling Lots!! Dual GTX 560 rads with D5 pumps for each rad. One rad for each component
Memory Viper Steel 4 x 16GB DDR4 3600MHz not sure on the timings... Probably still at 2667!! :(
Video Card(s) Asus Strix 3090 with front and rear active full cover water blocks
Storage I'm bound to forget something here - 250GB OS, 2 x 1TB NVME, 2 x 1TB SSD, 4TB SSD, 2 x 8TB HD etc...
Display(s) 3 x Dell 27" S2721DGFA @ 7680 x 1440P @ 144Hz or 165Hz - working on it!!
Case The big Thermaltake that looks like a Case Mods
Audio Device(s) Onboard
Power Supply EVGA 1600W T2
Mouse Corsair thingy
Keyboard Razer something or other....
VR HMD No headset yet
Software Windows 11 OS... Not a fan!!
Benchmark Scores I've actually never benched it!! Too busy with WCG and FAH and not gaming! :( :( Not OC'd it!! :(
Hi @phill !

I have been putting the 2 x R710 to good use during the home confinement up until now (eventhough i could not use them as i first intended for the TechPowerUp! WCG team)

Both are lovely, and remarkably quiet once you send the appropriate raw hex values to the Intelligent Plateform Management Interface (aka IPMI).

I'll catch up later this year, when my room temp goes below 28°C, and will start crunching again soon.

For now, both servers are living a peacefull life in a 6U open chassis near me :



Anyway, back to this rendering server project log, since i finally received the most important part of the server : the GPU enablement kit (a 4 ways power splitter daughter board, and 4 x 8pins to 8pins + 6 Pins GPU power cables)

I took a picture of the motherboard for quick reference, just to make sure i would be able to put everything back into place after this hardware upgrade :



then I proceeded to unscrew all mounting screws, remove all centering studs from the motherboard to set it completely free, and finally unplug all motherboard cables, in order to reach the power circuitry hidden under the motherboard tray :



All i had to do was to plug the daughter board into the place provided for this purpose:



Then attach all 4 power cables to feed 4 hungry GPUs:



Putting back everything into place was rather easy, then i put the cooling shroud over both Heatsinks, insert both hot swappable chassis fans, and proceeded to plug 2 GPU into the server: the first one in the first PCI 3.0 slot, and the second card in the third PCI 3.0 slot



But there was NO WAY i could properly close the side panel anymore : the power cables of the newly installed GPU on the upper PCI-E slot would bump against the locking mechanism ! Hopefully, moving the GPU to the second PCI 3.0 slot did the trick, but there's a downside to this : the GPU is almost touching the RAID controller, and those PERC H730 cards can run pretty hot, adding even more heat to an already extremely hot GPU card. But it's not like i had much choice so i settled for this setup :



I will have to give it a good thinking again otherwise i will never be able to add 2 more GPUs in the future (i'm already looking for some angled 8pins + 6pins adapters i could use in this server, if you guys know some brands and shops where to buy them in the EU, it would be pretty much appreciated)

On a side note : i thought i could use those 2 anti-saging support brackets which came with the server, unfortunately both RTX 2070 super are too bulky and the brackets won't fit anymore.



They were most likely designed to support quadro / nvs cards which are thinner than the one i put in the server. Well nevermind that :)

That's it for this second update, i will post more soon, as there is one last piece of hardware to put in the server in order to cool it adequately : a massive 4 fans cooling rack i ordered on ebay a couple weeks ago. Teaser : those 4 suckers can work at any given speed between 1200 and 12000 RPM when they are set to maximum speed :eek:o_O

Thanks for watching this thread !
So very glad to see and hear from you my good friend!! :D :D

Glad to hear your making the most of 2 of them, do you still have the others as well? :) I need to look into making the few servers I have left here quieter, I'm sure there's a way and I'll take a look into the Intelligent Plateform Management Interface (aka IPMI) you mentioned if I can Google it, probably not at 130am tho!

But anyways, enough de-railing :D :D That server is going to rock for rendering!! :D :D Will we be able to see the results of what the differences where at stock and with all the monster cards in place?? :)
Those cooling fans must be double Delta's for that speed rating!! Jesus... What size fans are they?? 80mm??

Looking forward to the next part update!! :D :D

It didn’t click at first where I’ve seen the two Dell server’s before. There from you @phill?
They where indeed :D :D
 
Joined
Oct 24, 2004
Messages
1,294 (0.18/day)
Yes indeed @phill , those are 80mm fans, all 6 of them !

So, i received the last piece of hardware today : the DELL optional fans kit (Part # 56F1P, required for multiple GPUs cooling, or when you fill all 18 drives bays)





Those are hot swappables Delta brushless DC fans, rated 12V / 3A.



Before installing this optional ventilation system, there was a lot of room in front of the cooling shroud intake:



Putting the fan rack into place requires no efforts, as it slides nicely against the guiding rails on top & bottom case, landing exactely into the 4 DELL's proprietary PWN connectors



Here's the final result, once everything is plugged. At this point the hardware assembly is over.



I didn't go too far into the bios :
- Disable the onboard VGA chipset after the POST is done
- Disable the DELL lifecycle controller routine during the boot (it takes forever to complete)
- Enable the integrated DELL remote access card (IDRAC8)
- Activate the IPMI-over-lan feature
- Drop the use of the dedicated IDRAC nic in favor of the second lan-on-motherboard (LOM2)
- Set a static IP and some administrator credentials, to later access the IDRAC through the network.

The server roared with all 6 fans set at the default (immutable) 3600RPM speed, and after a painful 2 mins boot, Windows desktop finally loaded.

I gathered various informations through CPU-Z and GPU-Z, to make sure everything was just as expected :

1598724777783.png


Then benchmarked the server with 3Dmark basic edition :


Capture01.jpg




Capture02.jpg


Capture03.jpg


I think we're good go !

As usual, thanks for reading this post, see you soon for the last part of this project log. :p
 
Last edited:

phill

Moderator
Staff member
Joined
Jun 8, 2011
Messages
17,049 (3.43/day)
Location
Somerset, UK
System Name Not so complete or overkill - There are others!! Just no room to put! :D
Processor Ryzen Threadripper 3970X
Motherboard Asus Zenith 2 Extreme Alpha
Cooling Lots!! Dual GTX 560 rads with D5 pumps for each rad. One rad for each component
Memory Viper Steel 4 x 16GB DDR4 3600MHz not sure on the timings... Probably still at 2667!! :(
Video Card(s) Asus Strix 3090 with front and rear active full cover water blocks
Storage I'm bound to forget something here - 250GB OS, 2 x 1TB NVME, 2 x 1TB SSD, 4TB SSD, 2 x 8TB HD etc...
Display(s) 3 x Dell 27" S2721DGFA @ 7680 x 1440P @ 144Hz or 165Hz - working on it!!
Case The big Thermaltake that looks like a Case Mods
Audio Device(s) Onboard
Power Supply EVGA 1600W T2
Mouse Corsair thingy
Keyboard Razer something or other....
VR HMD No headset yet
Software Windows 11 OS... Not a fan!!
Benchmark Scores I've actually never benched it!! Too busy with WCG and FAH and not gaming! :( :( Not OC'd it!! :(
Well mate, hats off to you sir and I can't wait to see more!! :D :D

I'll drop you a PM about the IMPI setup, I have a feeling I could really do with that being setup!! :D :laugh:

Love the pics of the projects, I feel it makes it !! :D
 

atxartist

New Member
Joined
Feb 15, 2023
Messages
1 (0.00/day)
WOW... gives me hope after reading all this and the modifications you did. I am an artist (traditional art/paintings/drawing...etc..) and have been messing around with 3d rendering since I first was able to get my hands on 3D Studio Max way back in the day. Recently I've been trying out the Unreal Engine and their Metahuman creator as well as using the app for iphones (live link) to be able to take advantage of the rigged characters to have their faces move to whoever is being captured with the iphone live link app. So I've done a few live stream online selling using that method and it was way cool. However I instantly faced with the fact that the computer was hardly enough to render it and stream it without it taking forever and not being effective in looking smooth and voice matching up with the stream.

I just came into a Dell T630 at a great deal and got it with the intent to make it into my dedicated 3D rendering tool and started looking into setting it up and found I have to add alot before it can be used the way I'd like...so seeing your post with the modifications was GREAT! Gave me and idea of what I need to do and get ... maybe not to that extent since $$ can be an issue. But great nonetheless! Any suggestions you'd give on what to add and what to remove initially to get it able to do those things and later add more to get the Powerhouse you have? Any tips or advice would be AWESOME!

Alex
 
Top