28 cores Dual socket build (Project Boobs) (Completed)

[alucasa]

In my whole life, I've built 3 dual socket machines for my own usage.

The first one was a dual opteron rig. (Whooping 4cores!!!!)
The second one was AMD 4x4 platform.
The third was dual socket 771.

So, it's been a loooooooooooooooong time.

This thing will be for CPU rendering and, due to budget limitations, I can't buy everything at once. And I am watching sales.

CPU: It will be E-5 2683v3 x 2.

CPU heatsinks: ARCTIC Freezer i11 x 2. I use one and they are proven to work well for its relatively small size. Additionally, two large heatsinks have a risk of touching each other.


Mobo: Supermicro MBD-X10DAL-I-O

RAM:

Case: Fractal Define C - Window

PSU: EVGA SuperNOVA 750 https://www.newegg.ca/Product/Product.aspx?Item=N82E16817438025

PSU is tricky to choose because I do not want to use converters or splitters. So I have to choose one with two CPU plugs. 24 + 8 + 8 is not a common config. My current PSU doesn't have the extra (2nd) 8pin. The one I linked above does come with 24 + 8 + 8. There are few more in the same price range.


GPU: What I have which is PNY 1060 6GB


Rig testing with 1 CPU and 760 GTX

Final setup with 2 CPUs and 1060 6GB GTX

 

[r9]

In my whole life, I've built 3 dual socket machines for my own usage.

The first one was a dual opteron rig. (Whooping 4cores!!!!)
The second one was AMD 4x4 platform.
The third was dual socket 771.

So, it's been a loooooooooooooooong time.

This thing will be for CPU rendering and, due to budget limitations, I can't buy everything at once. And I am watching sales.

CPU: 2683v3 (14 cores @ 2.0ghz) x2 - Actually, this could change. There is also 2673v3 that has similar performance (12 cores @ 2.4ghz). I am just watching good prices. I want to avoid Engineering Samples(ES) but if I can find good price for a fair of Qualification Samples(QS), then I will go for it.

I do have my current 2683v3 CPU but its price has been going up steadily ever since Ryzen got released. I bought this one at 450CAD. Now it's at 600CAD. I ain't happy about this. I expected the price to go down.

CPU heatsinks: ARCTIC Freezer i11 x 2. I use one and they are proven to work well for its relatively small size. Additionally, two large heatsinks have a risk of touching each other.

Mobo: Asus Z10pa-D8 https://www.amazon.ca/dp/B00O1A68NS...UTF8&colid=4I9RGY00LH0T&coliid=I199CBI572RS2P

or Supermicro MBD-X10DRL-I https://www.newegg.ca/Product/Product.aspx?Item=N82E16813182944&ignorebbr=1

Moherboard is the hardest choice here. Supermicro ones are the cheapest at 420CAD but they do not strictly follow ATX standard. Asus one is more at 460 ~ 510 CAD but follows ATX standard along with more consumer-oriented features.
Currently, Asus Z10PA-D8 is cheapest at Amazon.ca @ 460CAD but is out of stock. (510 ~ 560 at everywhere else) I've placed my order @ amazon but they have yet to give me an ETA.

Supermicro is supported and favored by Newegg but Supermicro has got their own ATX standard which forces me to buy Supermicro case for perfect fit or get a case without builtin standoffs and use plastic standoffs, so I decided to go with Asus one that follows ATX standard.


RAM: Kingston 8GB DDR4 2133MHz ECC https://www.amazon.ca/dp/B00NLZAO8E...UTF8&colid=4I9RGY00LH0T&coliid=I3NWSNYL5RVUFD

Not much choice here. From my experience, as long as I use single CPU, regular non-ECC rams will work. If I am going to use 2 CPUs though, I must use registered. At least, that's how I remember back in socket 771 days.


Case: Fractal Design Define C https://www.newegg.ca/Product/Product.aspx?Item=N82E16811352063&_ga=1.135586100.488184926.1473965862

or Corsair 400C https://www.newegg.ca/Product/Product.aspx?Item=N82E16811139072&_ga=1.172607782.488184926.1473965862

I must choose Fractal Define C if I buy a Supermicro board. But, since I chose Asus one, Corsair 400C is also a choice. If I need to fall back to Supermicro board (in case Amazon gives me too long of an ETA), I will need to get Fractal one. I am going to decide on the case once mobo is set.


PSU: EVGA SuperNOVA 750 https://www.newegg.ca/Product/Product.aspx?Item=N82E16817438025

PSU is tricky to choose because I do not want to use converters or splitters. So I have to choose one with two CPU plugs. 24 + 8 + 8 is not a common config. My current PSU doesn't have the extra (2nd) 8pin. The one I linked above does come with 24 + 8 + 8. There are few more in the same price range.


GPU: GPU doesn't really matter. Eventually, it will use my current 1060 GTX or I am willing to downgrade to 1050ti to lose PCIe power cables. Even RX460 is a choice, I think. I don't game much and even when I do, it's Crusader Kings or Football manager or games that don't require monsterous GPU powers.



Storage: Since M.2 isn't an option (unless I choose Asus one, even then I am restricted to M.2 2242), I will need to buy a new SSD. Will probably grab a cheap one in due time. This isn't really important.

Ultimately, it will have OS SSD, a storage SSD or HDD, and finally a backup HDD.


The buttock line

The whole build is tricky and is going to take months. Once mobo and case are set and I have them, I am going to try moving CPU and GPU from my current main rig and boot it up to see mobo is actually working. I reckon I will be running only 1 CPU for a while before finally going for the 2nd, identical, CPU - or grab a new pair for a deal.

I dislike this kind of big build where I have to wait months for all parts to be there, but this sort of build is wayyyyy out of my budget limit to have it go in a single month.

So, the plan in nutshell is like this.

March to early April = Secure mobo and then choose case.
Late April to early May = Acquire PSU, a new SSD, and a pair of ECC RAM to start. Move stuff from my main rig to this and see if it works and is stable.
Late May to early June = Get 2nd CPU or seek a new pair if 2683v3 price keeps going up.
Finally, late June to July = More RAM. I will eventually populate at least 4 slots (2 each per cpu) with 8gb sticks.

For now, sorry, no pictures for you. I got nothing. Mobo is on order and that's it. After this build is over, I will build a Ryzen rig.

Subscribed.

 

[Vayra86]

This is shaping up to be the best boob job ever

 

[alucasa]

A change of plan. I went for the 2nd CPU first because it seems overall stock for E5-2683v3 CPU is dwindling. I fear the price will go up even more in 3 months of time, so I chose to get the CPU first.

Will post a picture of CPU when it arrives. I chose the seller I bought the first CPU from despite of his higher price. It was a matter of trust.

FYI, a search link to ebay on 2683v3 cpu

And this is the seller I bought the both CPUs from. Not ES, not QS, but OEM CPU.http://www.ebay.ca/itm/Intel-Xeon-E...199835?hash=item4d5443a01b:g:S0wAAOSwFGNWTefD

 

[CAPSLOCKSTUCK]

Subbing with a booby joke



Q: When was the last time most geeks touched a warm breast?


A: In a KFC bucket

 

[cdawall]

Jesus the prices have gone up I got my 2683V4 for $350 they are $520+ now that is nuts.

 

[alucasa]

Jesus the prices have gone up I got my 2683V4 for $350 they are $520+ now that is nuts.

Same. I bought first one at 350. Stock is going out and I think sellers are matching prices with Ryzen 1800X which has identical performance. I just could not afford to wait 3 months. Who knows how high it will go once stock gets thin.

 

[cdawall]

Same. I bought first one at 350. Stock is going out and I think sellers are matching prices with Ryzen 1800X which has identical performance. I just could not afford to wait 3 months. Who knows how high it will go once stock gets thin.

Luckily I only need the one chip on my little mini-ITX box and the term need is used very lightly here.

 

[alucasa]

So, the CPU is here. In fact, I swapped out the CPU to see whether it works. I am typing from the new CPU in the rig. Everything checks out.

I am glad that I got the 2nd CPU first because its price on Ebay has gone up and now I'd need to pay 660 CAD. I'd be kicking myself in nuts if I didn't buy the 2nd CPU first.

More updates soon, hopefully.

 

[dorsetknob]

alucasa

You slipped up with Photo (missed Opportunity )

i would have (seeing you have named this Build)
used a Bra as back drop with one CPU per Cup.... yeh i'm like that

 

[biffzinker]

How about these boobies?

For you @dorsetknob

 

[yotano211]

How about these boobies?

For you @dorsetknob

It appears those are not made of silicone

 

[biffzinker]

It appears those are not made of silicone

Well yeah. Have to err on the side of cautious since it is TPU. Wouldn't want to get a mod after myself.

 

[dorsetknob]

It appears those are not made of silicone

they are certainly Team Blue

 

[Vayra86]

Who's been chewing on that right-hand side Xeon IHS?

 

[alucasa]

Who's been chewing on that right-hand side Xeon IHS?

They all come like that. I don't know what they did with them but they work flawlessly. Personally though? I think the Chinese made these. They all come battered. The photo doesn't show it well though. Unless it is stated as "Grade A", they will look battered. But then a grade A chip won't be sold for 400USD.

Anyway, the case has finally been decided and has been ordered.
Despite of what I wrote at the beginning, I ultimately chose NZXT S340 Matte black/blue. I was going to choose Fractal but something about its appearance did not please me. Additionally, NZXT is 20 dollars cheaper here. I used a $100 Amazon gift card to buy it with free shipping which itself additionally saved 15 bucks. It's out of stock on Amazon though. ETA is late April but it should get here earlier than that.

Mobo will be Supermicro but I have to wait until April 15th at which point my CC balance will be for May bill. That is when I will buy it.

As for RAM, I think I will purchase 2nd hand RAM from Ebay. Hynix HMA41GR7MFR4N-TF is on sale for 87 CAD on Ebay and that RAM is on QVL list for the motherboard. With shipping, it's 95 CAD. If I buy something similar in Canada, it's 100 ~ 110 CAD with 13% TAX AND shipping of 10. The downside of buying it on Ebay is slow shipping.

Finally, I've been thinking about CPU cooling. From my past experience with building dual socket rigs, the inside gets really cramped with 2 CPU coolers.
So, I am thinking a Cooler Master Hyper 212 on right CPU and CORSAIR Hydro Series H55 on left CPU. This method will also reduce overall # of fans in the case by one. It could work.

Finally (for real), I hope the standoffs on the NZXT case are removeable. I have conflicting reports on this.

 

[Killerdroid]

What's the rig going to be used for?
I don't think 2 Xeon's will make your Pr0n collection go any faster

 

[alucasa]

I've been an amatuer Blender artist for about 5 years now.

So, Blender mainly. (CPU Rendering) I also use Terragen. GPU rendering ain't really an option due to low vRAM.

Blender can use up to 64 threads, so this is pretty much maxing it.

 

[Killerdroid]

I've been an amatuer Blender artist for about 5 years now.

So, Blender mainly. (CPU Rendering) I also use Terragen. GPU rendering ain't really an option due to low vRAM.

Blender can use up to 64 threads, so this is pretty much maxing it.

3Ds Max user here. Need all the Cuda I can get with iray as the main render engine.

I never knew Blender chewed CPU's.

PS: Are you a hobbyist or create to sell, or work in the industry?

 

[Sasqui]

Mobo will be Supermicro but I have to wait until April 15th at which point my CC balance will be for May bill.

What is it about not quite following the ATX standard on that board? Hole spacing?

Nice pair of silicon boobs. Who'd have thought those things pack so many cores, wow.

 

[alucasa]

3Ds Max user here. Need all the Cuda I can get with iray as the main render engine.
I never knew Blender chewed CPU's.

PS: Are you a hobbyist or create to sell, or work in the industry?

Strictly a hobbyist. I mainly do sci-fi stuff. I was happy with i7 4c/8t until I got a taste of E5-2683v3 on the cheap. It was 350USD back then. The price has gone up a lot now.

I am expecting Cinebench R15 score of 3400 from this rig when built. I hate being restricted on GPU vRAM.

What is it about not quite following the ATX standard on that board? Hole spacing?

Nice pair of silicon boobs. Who'd have thought those things pack so many cores, wow.

2 or 3 holes won't line up by an inch or so. I have plastic standoffs but the case must not have integrated standoffs.

I will show you eventually with photos.

 

[Killerdroid]

Strictly a hobbyist. I mainly do sci-fi stuff. I was happy with i7 4c/8t until I got a taste of E5-2683v3 on the cheap. It was 350USD back then. The price has gone up a lot now.

I am expecting Cinebench R15 score of 3400 from this rig when built. I hate being restricted on GPU vRAM.

There is a huge market for SCI-FI models, landscapes, clothing, machines, buildings etc....
I was looking at a similar setup to you but the Xeon's were only ES + it was a Hackintosh rig.
The E5-2683v3 will set you back £500 a pop in the UK. Not worth it for a hobbyist like myself.
How much VRAM do you need exactly? I'm not familiar with Terragen but 2 GTX 780 Ti's or 980 Ti's handle most rendering engines with ease.

 

[alucasa]

There is a huge market for SCI-FI models, landscapes, clothing, machines, buildings etc....
I was looking at a similar setup to you but the Xeon's were only ES + it was a Hackintosh rig.
The E5-2683v3 will set you back £500 a pop in the UK. Not worth it for a hobbyist like myself.
How much VRAM do you need exactly? I'm not familiar with Terragen but 2 GTX 780 Ti's or 980 Ti's handle most rendering engines with ease.

I use CUDA when the machine is rendering and I want to still use Blender. Blender works in instances, so if I open up a new Blender instance and set it to use CUDA, it will use only a single thread or so and rest of processing work on CUDA.

Since I can tell Blender how many threads it is allowed to use, on my current rig, I set it to use 24 threads and I use 4 threads for browsing and CUDA processing.

Terragen does not use GPU.

As for RAM, it's easy to go over 5GB due to bump and spec maps, add in high sub div it can get high. I usually do 2k textures. 4k texture is a waste of RAM. It's fairly easy to go over 10GB of RAM. Add in overhead and whatnot, you are looking at 12gb RAM consumption maximum in my case.
On average, I use 5 ~ 8GB ram. But I can easily go over 16gb ram I currently have. I don't 90% of time go over that though.

 

[Killerdroid]

I use CUDA when the machine is rendering and I want to still use Blender. Blender works in instances, so if I open up a new Blender instance and set it to use CUDA, it will use only a single thread or so and rest of processing work on CUDA.

Since I can tell Blender how many threads it is allowed to use, on my current rig, I set it to use 24 threads and I use 4 threads for browsing and CUDA processing.

Terragen does not use GPU.

As for RAM, it's easy to go over 5GB due to bump and spec maps, add in high sub div it can get high. I usually do 2k textures. 4k texture is a waste of RAM. It's fairly easy to go over 10GB of RAM. Add in overhead and whatnot, you are looking at 12gb RAM consumption maximum in my case.
On average, I use 5 ~ 8GB ram. But I can easily go over 16gb ram I currently have. I don't 90% of time go over that though.

I also use Cuda and I've never had to tinker with settings. I leave the CPU off when rendering and let the GPU's do the work.
Have you ever considered using 3ds Max as it seems blender bogs the system down from what you're saying?
You can get Max free for 3 years. Just sign up as a student.

 

[alucasa]

Can't pay that much for 3D Max. Besides, I am too used to Blender. And, in my opinion, CPU rendering is better, due to flexibility of RAM.

I am not sure what you mean by blender is bogging down the system? It's rendering which is probably one of the most processor intensive work. Of course, it will slow down any system if using all resources. Having more threads gives me options to divert some threads for my own use during a render.