Cloudflare Deploys AMD EPYC Processors Across its Latest Gen X Servers

btarunr · Feb 25, 2020

The ubiquitous DDoS-mitigation and CDN provider, Cloudflare, announced that its latest Gen X servers implement AMD EPYC processors ditching Intel Xeons with its older Gen 9 servers. Cloudflare uses multi-functional servers (just like Google), in which each server is capable of handling any kind of the company's workloads (DDoS mitigation, content delivery, DNS, web-security, etc.). The company minimizes server hardware configurations so they're easier to maintain and lower TCO. The hardware specs of its servers are periodically updated and classified by "generations."

Cloudflare's Gen X server is configured with a single-socket 2nd gen AMD EPYC 7642 processor (48-core/96-thread, 256 MB L3 cache), and 256 GB of octa-channel DDR4-2933 memory, along with NVMe flash-based primary storage. "We selected the AMD EPYC 7642 processor in a single-socket configuration for Gen X. This CPU has 48-cores (96 threads), a base clock speed of 2.4 GHz, and an L3 cache of 256 MB. While the rated power (225 W) may seem high, it is lower than the combined TDP in our Gen 9 servers and we preferred the performance of this CPU over lower power variants. Despite AMD offering a higher core count option with 64-cores, the performance gains for our software stack and usage weren't compelling enough," Cloudflare writes in its blog post announcing Gen X. The new servers will go online in the coming weeks.

Many Thanks to biffzinker for the tip.

View at TechPowerUp Main Site

ebivan · Feb 25, 2020

Cable length doesn't look very cost effective. Looks like there is about 100g of unused copper in the wiring on the right. They could save some money if they were to cut them to length, or am I wrong?

btarunr · Feb 25, 2020

ebivan said:
Cable length doesn't look very cost effective. Looks like there is about 100g of unused copper in the wiring on the right. They could save some money if they were to cut them to length, or am I wrong?

That's probably an in-lab build by Cloudflare's engineers. Once they order that in bulk from their SI firm, they'll optimize the design in the manner you suggest.

laszlo · Feb 25, 2020

in other servers also you can see long cables...; i think psu's are manufactured with a specific length so not sure they'll be shorter to save copper/costs ....

noel_fs · Feb 25, 2020

ebivan said:
Cable length doesn't look very cost effective. Looks like there is about 100g of unused copper in the wiring on the right. They could save some money if they were to cut them to length, or am I wrong?

I would say you are wrong. Those PSU's i believe can last several years while that epyc platform wont outlast the PSU. So they could re-use those PSU's for a different platform that require different cable lenghts and thats a considerable saving the way I see it. I have no idea if its a practice they employ in this industry tho. I doubt cutting 50cm of cable will save much money.

GreiverBlade · Feb 25, 2020

seriously? talking about cable length is the only thing that piece of news inspire ...

:laugh:

herliTz1337 · Feb 25, 2020

Are those RAM dummys between the different slots?

GreiverBlade · Feb 25, 2020

herliTz1337 said:
Are those RAM dummys between the different slots?

slot protector i guess ...

notb · Feb 25, 2020

ebivan said:
Cable length doesn't look very cost effective. Looks like there is about 100g of unused copper in the wiring on the right. They could save some money if they were to cut them to length, or am I wrong?

Cloudfare is a small company and they use budget servers. Don't expect the kind of design and in-house solutions you see from Dell and the like.
It's likely a generic design they use for all systems. Some use more cables, some less.

The whole server looks a bit cheap and DIY, to be honest...

100g of Cu costs $8. Pennies.

Schmuckley · Feb 25, 2020

So this means I can gets the fastest 404 or 502 ever?

notb · Feb 25, 2020

laszlo said:
in other servers also you can see long cables...; i think psu's are manufactured with a specific length so not sure they'll be shorter to save copper/costs ....

Cables aren't connected directly to the PSU, but to the PSU enclosure you see in the photo. So they're as long as rack designer (Cloudfare) wanted.
Actual PSUs are modular - you slide them into that enclosure.

Logoffon · Feb 25, 2020

Schmuckley said:
So this means I can gets the fastest 404 or 502 ever?

"One more step" Captcha check and "Checking your browser before accessing...." to that as well. Now we don't have to wait for 522 ever again.

laszlo · Feb 25, 2020

notb said:
Cables aren't connected directly to the PSU, but to the PSU enclosure you see in the photo. So they're as long as rack designer (Cloudfare) wanted.
Actual PSUs are modular - you slide them into that enclosure.

not all server PSU's are modular...

notb · Feb 25, 2020

laszlo said:
not all server PSU's are modular...

But the one in the photo is.

laszlo · Feb 25, 2020

notb said:
But the one in the photo is.

i think you want to wrote is "not"

; look at the big hole on the left side of it with a bunch of cables coming out...

notb · Feb 25, 2020

laszlo said:
i think you want to wrote is "not" ; look at the big hole on the left side of it with a bunch of cables coming out...

Cables are connected to the PSU housing (precisely: to circuitry that makes the redundancy setup work).
Inside there are 2 PSUs. You can see one through the gaps.

The 2 black objects I've marked are handles for pulling the PSUs out.
It's a hot swap redundant PSU, so you can replace one on a running server.
That would be quite challenging with fixed wires.

This is how it looks from the back (different model):

laszlo · Feb 25, 2020

notb said:
Cables are connected to the PSU housing (precisely: to circuitry that makes the redundancy setup work).
Inside there are 2 PSUs. You can see one through the gaps.
View attachment 145909

The 2 black objects I've marked are handles for pulling the PSUs out.
It's a hot swap redundant PSU, so you can replace one on a running server.
That would be quite challenging with fixed wires.

This is how it looks from the back (different model):
View attachment 145908

i see now what u'r say; but not all of them are modular ...

notb · Feb 25, 2020

laszlo said:
i see now what u'r say; but not all of them are modular ...

Of course. I was talking about the one in photos.
Not every rack unit needs such a robust power supply, but - given the nature of Cloudflare's services - I bet it's money well spent.

R-T-B · Feb 26, 2020

notb said:
Cloudfare is a small company

Relative to? They are certainly a household name.

notb · Feb 27, 2020

R-T-B said:
Relative to? They are certainly a household name.

Well, I could be mean and say they'll even smaller than AMD.

But I meant: relative to other global buyers of server hardware. Which was meant to explain why the server shown in photos screams "budget".
Cloudflare is a leader in a very niche market.

R-T-B · Feb 27, 2020

notb said:
Well, I could be mean and say they'll even smaller than AMD.

But I meant: relative to other global buyers of server hardware. Which was meant to explain why the server shown in photos screams "budget".
Cloudflare is a leader in a very niche market.

Fair enough. Was just wondering your means of comparison.

Jism · Feb 27, 2020

Schmuckley said:
So this means I can gets the fastest 404 or 502 ever?

Its just more then that. If someone decides to DDOS techpowerup, without cloudflare, the DDOS is simply wearing out the resources on the server to the point that the website is no longer visible, or let alone responds to DNS queries. With Cloudflare, it acts as a in the middle using clever CDN shit to prevent that from happening.

A CDN is usefull if your service is global to have a equal amount of speed or something but it does'nt make much sense if your local.

System Name	RBMK-1000
Processor	AMD Ryzen 7 5700G
Motherboard	ASUS ROG Strix B450-E Gaming
Cooling	DeepCool Gammax L240 V2
Memory	2x 8GB G.Skill Sniper X
Video Card(s)	Palit GeForce RTX 2080 SUPER GameRock
Storage	Western Digital Black NVMe 512GB
Display(s)	BenQ 1440p 60 Hz 27-inch
Case	Corsair Carbide 100R
Audio Device(s)	ASUS SupremeFX S1220A
Power Supply	Cooler Master MWE Gold 650W
Mouse	ASUS ROG Strix Impact
Keyboard	Gamdias Hermes E2
Software	Windows 11 Pro

Processor	Ryzen 3900x
Motherboard	B550M Steel Legend
Cooling	XPX (custom loop)
Memory	32GB 3200MHz cl16
Video Card(s)	3080 with Bykski block (custom loop)
Storage	980 Pro
Case	Fractal 804
Power Supply	Focus Plus Gold 750FX
Mouse	G603
Keyboard	G610 brown
Software	yes, lots!

System Name	RBMK-1000
Processor	AMD Ryzen 7 5700G
Motherboard	ASUS ROG Strix B450-E Gaming
Cooling	DeepCool Gammax L240 V2
Memory	2x 8GB G.Skill Sniper X
Video Card(s)	Palit GeForce RTX 2080 SUPER GameRock
Storage	Western Digital Black NVMe 512GB
Display(s)	BenQ 1440p 60 Hz 27-inch
Case	Corsair Carbide 100R
Audio Device(s)	ASUS SupremeFX S1220A
Power Supply	Cooler Master MWE Gold 650W
Mouse	ASUS ROG Strix Impact
Keyboard	Gamdias Hermes E2
Software	Windows 11 Pro

System Name	2nd AMD puppy
Processor	FX-8350 vishera
Motherboard	Gigabyte GA-970A-UD3
Cooling	Cooler Master Hyper TX2
Memory	16 Gb DDR3:8GB Kingston HyperX Beast + 8Gb G.Skill Sniper(by courtesy of tabascosauz &TPU)
Video Card(s)	Sapphire RX 580 Nitro+;1450/2000 Mhz
Storage	SSD :840 pro 128 Gb;Iridium pro 240Gb ; HDD 2xWD-1Tb
Display(s)	Benq XL2730Z 144 Hz freesync
Case	NZXT 820 PHANTOM
Audio Device(s)	Audigy SE with Logitech Z-5500
Power Supply	Riotoro Enigma G2 850W
Mouse	Razer copperhead / Gamdias zeus (by courtesy of sneekypeet & TPU)
Keyboard	MS Sidewinder x4
Software	win10 64bit ltsc
Benchmark Scores	irrelevant for me

Processor	Ryzen 5700X
Motherboard	Gigabyte B550 Arous Elite V2
Cooling	Thermalright PA120
Memory	Kingston FURY Renegade 3600Mhz @ 3733 tight timings
Video Card(s)	Sapphire Pulse RX 6800
Storage	36TB
Display(s)	Samsung QN90A
Case	be quiet! Dark Base Pro 900
Audio Device(s)	Khadas Tone Pro 2, HD660s, KSC75, JBL 305 MK1
Power Supply	Coolermaster V850 Gold V2
Mouse	Roccat Burst Pro
Keyboard	Dogshit with Otemu Brown
Software	W10 LTSC 2021

Cloudflare Deploys AMD EPYC Processors Across its Latest Gen X Servers

btarunr

Editor & Senior Moderator

ebivan

btarunr

Editor & Senior Moderator

laszlo

noel_fs

GreiverBlade

herliTz1337

GreiverBlade

notb

Schmuckley

notb

Logoffon

laszlo

notb

laszlo

notb

laszlo

notb

R-T-B

notb

R-T-B

Jism

System Name	main/SFFHTPCARGH!(tm)/Xiaomi Mi TV Stick/Samsung Galaxy S23/Ally
Processor	Ryzen 7 5800X3D/i7-3770/S905X/Snapdragon 8 Gen 2/Ryzen Z1 Extreme
Motherboard	MSI MAG B550 Tomahawk/HP SFF Q77 Express/uh?/uh?/Asus
Cooling	Enermax ETS-T50 Axe aRGB /basic HP HSF /errr.../oh! liqui..wait, no:sizable vapor chamber/a nice one
Memory	64gb DDR4 3600/8gb DDR3 1600/2gbLPDDR3/8gbLPDDR5x/16gb(10 sys)LPDDR5 6400
Video Card(s)	Hellhound Spectral White RX 7900 XTX 24gb/GT 730/Mali 450MP5/Adreno 740/Radeon 780M 6gb LPDDR5
Storage	250gb870EVO/500gb860EVO/2tbSandisk/NVMe2tb+1tb/4tbextreme V2/1TB Arion/500gb/8gb/256gb/4tb SN850X
Display(s)	X58222 32" 2880x1620/32"FHDTV/273E3LHSB 27" 1920x1080/6.67"/AMOLED 2X panel FHD+120hz/7" FHD 120hz
Case	Cougar Panzer Max/Elite 8300 SFF/None/Gorilla Glass Victus 2/front-stock back-JSAUX RGB transparent
Audio Device(s)	Logi Z333/SB Audigy RX/HDMI/HDMI/Dolby Atmos/KZ x HBB PR2/Moondrop Chu II + TRN BT20S
Power Supply	Chieftec Proton BDF-1000C /HP 240w/12v 1.5A/USAMS GAN PD 33w/USAMS GAN 100w
Mouse	Speedlink Sovos Vertical-Asus ROG Spatha-Logi Ergo M575/Xiaomi XMRM-006/touch/touch
Keyboard	Endorfy Thock 75%/Lofree Edge/none/touch/virtual
VR HMD	Medion Erazer
Software	Win10 64/Win8.1 64/Android TV 8.1/Android 14/Win11 64
Benchmark Scores	bench...mark? i do leave mark on bench sometime, to remember which one is the most comfortable. :o

System Name	Some computer stuff
Processor	Mostly Intel or AMD
Motherboard	ATX or mATX
Cooling	Bong Cooler
Memory	DDR2-4
Video Card(s)	A few
Storage	Plenty Platters or SSDs or USBs
Display(s)	Samsung 23"
Case	5 on the floor
Audio Device(s)	There's one for my M7 Gene, Oh I have 3-4 PCI 5.1 ones.Sabrent! lol
Power Supply	750-1000W
Mouse	cheap
Keyboard	Used ps2 from garage sales
Software	Yeah
Benchmark Scores	http://hwbot.org/user/schmuckley/#Hardware_Library http://valid.canardpc.com/rbjpbg

System Name	Pioneer
Processor	Ryzen R9 9950X
Motherboard	GIGABYTE Aorus Elite X670 AX
Cooling	Noctua NH-D15 + A whole lotta Sunon and Corsair Maglev blower fans...
Memory	64GB (4x 16GB) G.Skill Flare X5 @ DDR5-6000 CL30
Video Card(s)	XFX RX 7900 XTX Speedster Merc 310
Storage	Intel 905p Optane 960GB boot, +2x Crucial P5 Plus 2TB PCIe 4.0 NVMe SSDs
Display(s)	55" LG 55" B9 OLED 4K Display
Case	Thermaltake Core X31
Audio Device(s)	TOSLINK->Schiit Modi MB->Asgard 2 DAC Amp->AKG Pro K712 Headphones or HDMI->B9 OLED
Power Supply	FSP Hydro Ti Pro 850W
Mouse	Logitech G305 Lightspeed Wireless
Keyboard	WASD Code v3 with Cherry Green keyswitches + PBT DS keycaps
Software	Gentoo Linux x64 / Windows 11 Enterprise IoT 2024