• Welcome to TechPowerUp Forums, Guest! Please check out our forum guidelines for info related to our community.

AMD X399 Platform Lacks NVMe RAID Booting Support

Joined
Jul 19, 2006
Messages
43,610 (6.47/day)
Processor AMD Ryzen 7 7800X3D
Motherboard ASUS TUF x670e-Plus Wifi
Cooling EK AIO 360. Phantek T30 fans.
Memory 32GB G.Skill 6000Mhz
Video Card(s) Asus RTX 4090
Storage WD/Samsung m.2's
Display(s) LG C2 Evo OLED 42"
Case Lian Li PC 011 Dynamic Evo
Audio Device(s) Topping E70 DAC, SMSL SP200 Amp, Adam Audio T5V's, Hifiman Sundara's.
Power Supply FSP Hydro Ti PRO 1000W
Mouse Razer Basilisk V3 Pro
Keyboard Epomaker 84 key
Software Windows 11 Pro
But I can still raid non-boot drives. I'm fine with that... If I were to buy a Threadripper... Which I'm not.
 
Joined
Jul 29, 2014
Messages
484 (0.13/day)
Location
Fort Sill, OK
Processor Intel 7700K 5.1Ghz (Intel advised me not to OC this CPU)
Motherboard Asus Maximus IX Code
Cooling Corsair Hydro H115i Platinum
Memory 48GB G.Skill TridentZ DDR4 3200 Dual Channel (2x16 & 2x8)
Video Card(s) nVIDIA Titan XP (Overclocks like a champ but stock performance is enough)
Storage Intel 760p 2280 2TB
Display(s) MSI Optix MPG27CQ Black 27" 1ms 144hz
Case Thermaltake View 71
Power Supply EVGA SuperNova 1000 Platinum2
Mouse Corsair M65 Pro (not recommded, I am on my second mouse with same defect)
Software Windows 10 Enterprise 1803
Benchmark Scores Yes I am Intel fanboy that is my benchmark score.
I am kind of astonished at using objective language here. Did TECHPOWERUP not get their customized review kit from AMD?.
"Ryzen Threadripper HEDT platform may have an Achilles's heel after all" is too far fetched even for Techpowerup.

Reminds me of how HARDOCP used to trash AMD every chance they get especially right after Kyle did not get invited to one of AMD Polaris event. But attitude changed right after they send him couple of samples.

For real there might be less then 1% of TR consumes who would RAID 0 two of their PCI x4 NVME drives.
 

cdawall

where the hell are my stars
Joined
Jul 23, 2006
Messages
27,680 (4.11/day)
Location
Houston
System Name All the cores
Processor 2990WX
Motherboard Asrock X399M
Cooling CPU-XSPC RayStorm Neo, 2x240mm+360mm, D5PWM+140mL, GPU-2x360mm, 2xbyski, D4+D5+100mL
Memory 4x16GB G.Skill 3600
Video Card(s) (2) EVGA SC BLACK 1080Ti's
Storage 2x Samsung SM951 512GB, Samsung PM961 512GB
Display(s) Dell UP2414Q 3840X2160@60hz
Case Caselabs Mercury S5+pedestal
Audio Device(s) Fischer HA-02->Fischer FA-002W High edition/FA-003/Jubilate/FA-011 depending on my mood
Power Supply Seasonic Prime 1200w
Mouse Thermaltake Theron, Steam controller
Keyboard Keychron K8
Software W10P
I am kind of astonished at using objective language here. Did TECHPOWERUP not get their customized review kit from AMD?.
"Ryzen Threadripper HEDT platform may have an Achilles's heel after all" is too far fetched even for Techpowerup.

Reminds me of how HARDOCP used to trash AMD every chance they get especially right after Kyle did not get invited to one of AMD Polaris event. But attitude changed right after they send him couple of samples.

For real there might be less then 1% of TR consumes who would RAID 0 two of their PCI x4 NVME drives.

So? That doesn't mean it shouldn't support it for the 1% who do
 
Joined
Jul 29, 2014
Messages
484 (0.13/day)
Location
Fort Sill, OK
Processor Intel 7700K 5.1Ghz (Intel advised me not to OC this CPU)
Motherboard Asus Maximus IX Code
Cooling Corsair Hydro H115i Platinum
Memory 48GB G.Skill TridentZ DDR4 3200 Dual Channel (2x16 & 2x8)
Video Card(s) nVIDIA Titan XP (Overclocks like a champ but stock performance is enough)
Storage Intel 760p 2280 2TB
Display(s) MSI Optix MPG27CQ Black 27" 1ms 144hz
Case Thermaltake View 71
Power Supply EVGA SuperNova 1000 Platinum2
Mouse Corsair M65 Pro (not recommded, I am on my second mouse with same defect)
Software Windows 10 Enterprise 1803
Benchmark Scores Yes I am Intel fanboy that is my benchmark score.
So? That doesn't mean it shouldn't support it for the 1% who do

Once more again if u cant read! Of course these small issues should be reported for sake of Journalism but using biased/strong words like "Achilles's heel" is taking it too far. This is just one disadvantage that was found and reviews are not even out yet. What happens when next flaw is found in TR. We going to call it Total disappointment and not recommended?

It takes just one person to start the Fire and headlines like such do a pretty good job.
 
Last edited:

cdawall

where the hell are my stars
Joined
Jul 23, 2006
Messages
27,680 (4.11/day)
Location
Houston
System Name All the cores
Processor 2990WX
Motherboard Asrock X399M
Cooling CPU-XSPC RayStorm Neo, 2x240mm+360mm, D5PWM+140mL, GPU-2x360mm, 2xbyski, D4+D5+100mL
Memory 4x16GB G.Skill 3600
Video Card(s) (2) EVGA SC BLACK 1080Ti's
Storage 2x Samsung SM951 512GB, Samsung PM961 512GB
Display(s) Dell UP2414Q 3840X2160@60hz
Case Caselabs Mercury S5+pedestal
Audio Device(s) Fischer HA-02->Fischer FA-002W High edition/FA-003/Jubilate/FA-011 depending on my mood
Power Supply Seasonic Prime 1200w
Mouse Thermaltake Theron, Steam controller
Keyboard Keychron K8
Software W10P
Once more again if u cant read! Of course these small issues should be reported for sake of Journalism but using strong words like "Achilles's heel" is taking it too far.

I don't disagree with that. I imagine the Achilles heel will more likely be infinity fabric connected the modules.
 
Joined
Jun 28, 2016
Messages
3,595 (1.16/day)
For real there might be less then 1% of TR consumes who would RAID 0 two of their PCI x4 NVME drives.
This is quite an interesting estimation...

I'm fairly sure quite an opposite observation is true.
I'd say that for a significant part of people that actually buy into HEDT, disks only come in RAID setups.

It's a bit like if TR was - for whatever reason - not usable for solving PDE. Who cares, right?

But here comes the actual problem.
Threadripper is known to be just a cut-down EPYC server CPU. Does that mean EPYC can't boot from a RAID as well? :)
 
Joined
Sep 6, 2013
Messages
3,418 (0.83/day)
Location
Athens, Greece
System Name 3 desktop systems: Gaming / Internet / HTPC
Processor Ryzen 5 7600 / Ryzen 5 4600G / Ryzen 5 5500
Motherboard X670E Gaming Plus WiFi / MSI X470 Gaming Plus Max (1) / MSI X470 Gaming Plus Max (2)
Cooling Aigo ICE 400SE / Segotep T4 / Νoctua U12S
Memory Kingston FURY Beast 32GB DDR5 6000 / 16GB JUHOR / 32GB G.Skill RIPJAWS 3600 + Aegis 3200
Video Card(s) ASRock RX 6600 + GT 710 (PhysX) / Vega 7 integrated / Radeon RX 580
Storage NVMes, ONLY NVMes / NVMes, SATA Storage / NVMe, SATA, external storage
Display(s) Philips 43PUS8857/12 UHD TV (120Hz, HDR, FreeSync Premium) / 19'' HP monitor + BlitzWolf BW-V5
Case Sharkoon Rebel 12 / CoolerMaster Elite 361 / Xigmatek Midguard
Audio Device(s) onboard
Power Supply Chieftec 850W / Silver Power 400W / Sharkoon 650W
Mouse CoolerMaster Devastator III Plus / CoolerMaster Devastator / Logitech
Keyboard CoolerMaster Devastator III Plus / CoolerMaster Devastator / Logitech
Software Windows 10 / Windows 10&Windows 11 / Windows 10
I don't see a huge problem here. I mean if someone wants to boot at 4.3 seconds instead of 5.6 seconds, yes this is a problem. In every other case it is just an annoyance of having probably one more drive and one more partition in your system and nothing more.
 
Joined
Dec 29, 2010
Messages
3,809 (0.74/day)
Processor AMD 5900x
Motherboard Asus x570 Strix-E
Cooling Hardware Labs
Memory G.Skill 4000c17 2x16gb
Video Card(s) RTX 3090
Storage Sabrent
Display(s) Samsung G9
Case Phanteks 719
Audio Device(s) Fiio K5 Pro
Power Supply EVGA 1000 P2
Mouse Logitech G600
Keyboard Corsair K95
I am kind of astonished at using objective language here. Did TECHPOWERUP not get their customized review kit from AMD?.
"Ryzen Threadripper HEDT platform may have an Achilles's heel after all" is too far fetched even for Techpowerup.

Reminds me of how HARDOCP used to trash AMD every chance they get especially right after Kyle did not get invited to one of AMD Polaris event. But attitude changed right after they send him couple of samples.

For real there might be less then 1% of TR consumes who would RAID 0 two of their PCI x4 NVME drives.

Yea, I've noticed the huge upswing in the anti-amd stance.
 

newtekie1

Semi-Retired Folder
Joined
Nov 22, 2005
Messages
28,473 (4.08/day)
Location
Indiana, USA
Processor Intel Core i7 10850K@5.2GHz
Motherboard AsRock Z470 Taichi
Cooling Corsair H115i Pro w/ Noctua NF-A14 Fans
Memory 32GB DDR4-3600
Video Card(s) RTX 2070 Super
Storage 500GB SX8200 Pro + 8TB with 1TB SSD Cache
Display(s) Acer Nitro VG280K 4K 28"
Case Fractal Design Define S
Audio Device(s) Onboard is good enough for me
Power Supply eVGA SuperNOVA 1000w G3
Software Windows 10 Pro x64
Not true. It works with all NVMe drives.

You don't need any keys/dongles to have a bootable raid 1 or 0 nvme raid configuration on x299 with ANY nvme drive.
Vroc is a different feature.

Yes, after doing some research which I admit I should have done before commenting, that is sort of correct.

If the slot is wired to the chipset, then yes you can use any brand drive in RAID and more than just RAID-0. Of course, this has the disadvantage of routing the data through the slower chipset path instead of directly to the CPU. It will limit the access speed from the rest of the system to the NVMe array to about that of a PCI-E 3.0 x4 link. If the slot is wired to the CPU, then you have to use VROC for RAID.
 

Aquinus

Resident Wat-man
Joined
Jan 28, 2012
Messages
13,171 (2.79/day)
Location
Concord, NH, USA
System Name Apollo
Processor Intel Core i9 9880H
Motherboard Some proprietary Apple thing.
Memory 64GB DDR4-2667
Video Card(s) AMD Radeon Pro 5600M, 8GB HBM2
Storage 1TB Apple NVMe, 4TB External
Display(s) Laptop @ 3072x1920 + 2x LG 5k Ultrafine TB3 displays
Case MacBook Pro (16", 2019)
Audio Device(s) AirPods Pro, Sennheiser HD 380s w/ FIIO Alpen 2, or Logitech 2.1 Speakers
Power Supply 96w Power Adapter
Mouse Logitech MX Master 3
Keyboard Logitech G915, GL Clicky
Software MacOS 12.1
This isn't SATA3. If 4x lanes of PCI-E 3.0 (which is ~3.84GB/s,) isn't enough for your boot drive, then you might as well just put everything you need into system memory.
Silly Windows users.
:toast:
 
Joined
Dec 16, 2010
Messages
1,668 (0.33/day)
Location
State College, PA, US
System Name My Surround PC
Processor AMD Ryzen 9 7950X3D
Motherboard ASUS STRIX X670E-F
Cooling Swiftech MCP35X / EK Quantum CPU / Alphacool GPU / XSPC 480mm w/ Corsair Fans
Memory 96GB (2 x 48 GB) G.Skill DDR5-6000 CL30
Video Card(s) MSI NVIDIA GeForce RTX 4090 Suprim X 24GB
Storage WD SN850 2TB, Samsung PM981a 1TB, 4 x 4TB + 1 x 10TB HGST NAS HDD for Windows Storage Spaces
Display(s) 2 x Viotek GFI27QXA 27" 4K 120Hz + LG UH850 4K 60Hz + HMD
Case NZXT Source 530
Audio Device(s) Sony MDR-7506 / Logitech Z-5500 5.1
Power Supply Corsair RM1000x 1 kW
Mouse Patriot Viper V560
Keyboard Corsair K100
VR HMD HP Reverb G2
Software Windows 11 Pro x64
Benchmark Scores Mellanox ConnectX-3 10 Gb/s Fiber Network Card
With AMD announcing that it is deprecating Crossfire and now not supporting bootable NVMe RAIDs, those 60 PCIe lanes that everyone was ogling over look more and more superfluous every day.
 

cdawall

where the hell are my stars
Joined
Jul 23, 2006
Messages
27,680 (4.11/day)
Location
Houston
System Name All the cores
Processor 2990WX
Motherboard Asrock X399M
Cooling CPU-XSPC RayStorm Neo, 2x240mm+360mm, D5PWM+140mL, GPU-2x360mm, 2xbyski, D4+D5+100mL
Memory 4x16GB G.Skill 3600
Video Card(s) (2) EVGA SC BLACK 1080Ti's
Storage 2x Samsung SM951 512GB, Samsung PM961 512GB
Display(s) Dell UP2414Q 3840X2160@60hz
Case Caselabs Mercury S5+pedestal
Audio Device(s) Fischer HA-02->Fischer FA-002W High edition/FA-003/Jubilate/FA-011 depending on my mood
Power Supply Seasonic Prime 1200w
Mouse Thermaltake Theron, Steam controller
Keyboard Keychron K8
Software W10P
This isn't SATA3. If 4x lanes of PCI-E 3.0 (which is ~3.84GB/s,) isn't enough for your boot drive, then you might as well just put everything you need into system memory.

:toast:
With AMD announcing that it is deprecating Crossfire and now not supporting bootable NVMe RAIDs, those 60 PCIe lanes that everyone was ogling over look more and more superfluous every day.

Depends how efficient the CPU is. If it can pull in $3-4 a day and support 8-12 video cards then the platform will be phenomenal to miners. Threadripper and 12 vega cards per rig, has a nice ring to it.
 
Joined
Jun 28, 2016
Messages
3,595 (1.16/day)
Yea, I've noticed the huge upswing in the anti-amd stance.
Well... I've noticed a huge shift of discussion topics from gaming to server/workstation-related because of how Zen is much better at compressing files than running games.
Sad part is that, while discussion themes changed, the people (their knowledge) didn't.

When a thread is about RAID and majority of comments is about NVMe speed and OS boot time, it kind of says it all...
 
Last edited:
Joined
Nov 19, 2014
Messages
113 (0.03/day)
Location
Toronto
but but but you still have all those picex lanes for all your...... 5400rpm hdds to connect muahahaha
 

Aquinus

Resident Wat-man
Joined
Jan 28, 2012
Messages
13,171 (2.79/day)
Location
Concord, NH, USA
System Name Apollo
Processor Intel Core i9 9880H
Motherboard Some proprietary Apple thing.
Memory 64GB DDR4-2667
Video Card(s) AMD Radeon Pro 5600M, 8GB HBM2
Storage 1TB Apple NVMe, 4TB External
Display(s) Laptop @ 3072x1920 + 2x LG 5k Ultrafine TB3 displays
Case MacBook Pro (16", 2019)
Audio Device(s) AirPods Pro, Sennheiser HD 380s w/ FIIO Alpen 2, or Logitech 2.1 Speakers
Power Supply 96w Power Adapter
Mouse Logitech MX Master 3
Keyboard Logitech G915, GL Clicky
Software MacOS 12.1
Depends how efficient the CPU is. If it can pull in $3-4 a day and support 8-12 video cards then the platform will be phenomenal to miners. Threadripper and 12 vega cards per rig, has a nice ring to it.
What does mining have to do with running NVMe devices in RAID other than using up PCI-E lanes that could be used for GPUs instead of NVMe? Very few situations require highly available persistent storage I/O of over 2GB/s and in those situations, I would argue that using an NVMe device suited to using more PCI-E lanes would be a better option than doing RAID, particularly for small file or random read/write operations.

My bigger point what that disk I/O has got fast enough where RAID-0 doesn't make a whole lot of sense. I did it with SATA3 not even for speed but, because at the time, RAID-0 of two 120GBs was cheaper than a single 240GB and just happened to be a little faster in certain situations. However, with how cheap SSD storage has become and how fast NVMe devices are getting, I see very little reason to want to do RAID-0 with NVMe devices. If you need something that fast but, require a replica, I would argue that something more eventually consistent would allow you to retain more performance while sacrificing a minute or so worth of data being written in the case of catastrophe.

All in all, I think that this article is a non-issue and isn't even worthy of the attention it is receiving. It's not a realistic need that solves any real tangible problem.
 

cdawall

where the hell are my stars
Joined
Jul 23, 2006
Messages
27,680 (4.11/day)
Location
Houston
System Name All the cores
Processor 2990WX
Motherboard Asrock X399M
Cooling CPU-XSPC RayStorm Neo, 2x240mm+360mm, D5PWM+140mL, GPU-2x360mm, 2xbyski, D4+D5+100mL
Memory 4x16GB G.Skill 3600
Video Card(s) (2) EVGA SC BLACK 1080Ti's
Storage 2x Samsung SM951 512GB, Samsung PM961 512GB
Display(s) Dell UP2414Q 3840X2160@60hz
Case Caselabs Mercury S5+pedestal
Audio Device(s) Fischer HA-02->Fischer FA-002W High edition/FA-003/Jubilate/FA-011 depending on my mood
Power Supply Seasonic Prime 1200w
Mouse Thermaltake Theron, Steam controller
Keyboard Keychron K8
Software W10P
What does mining have to do with running NVMe devices in RAID other than using up PCI-E lanes that could be used for GPUs instead of NVMe?

The question was "What is the point of 60 lanes if?"

That is one scenario that would use them. Another would be deep learning, cad/cam, video capture etc. Plenty of uses for pcie lanes outside of nvme devices.
 
Joined
Apr 18, 2016
Messages
184 (0.06/day)
1tldu3.jpg
 
Joined
Mar 7, 2010
Messages
994 (0.18/day)
Location
Michigan
System Name Daves
Processor AMD Ryzen 3900x
Motherboard AsRock X570 Taichi
Cooling Enermax LIQMAX III 360
Memory 32 GiG Team Group B Die 3600
Video Card(s) Powercolor 5700 xt Red Devil
Storage Crucial MX 500 SSD and Intel P660 NVME 2TB for games
Display(s) Acer 144htz 27in. 2560x1440
Case Phanteks P600S
Audio Device(s) N/A
Power Supply Corsair RM 750
Mouse EVGA
Keyboard Corsair Strafe
Software Windows 10 Pro
Joined
Jan 8, 2009
Messages
551 (0.09/day)
System Name AMD RyZen PC
Processor AMD RyZen 5950x
Motherboard ASUS Crosshair VIII Hero 570x WIFI
Cooling Custom Loop
Memory 64GB G.Skill Trident Z DDR4 3200 MHz 14C x4
Video Card(s) Evga 3080 TI
Storage Seagate 8TB + 3TB + 4TB + 2TB external + 512 Samsung 980
Display(s) LG 4K 144Hz 27GN950-B
Case Thermaltake CA-1F8-00M1WN-02 Core X71 Tempered Glass Edition Black
Audio Device(s) XI-FI 8.1
Power Supply EVGA 700W
Mouse Microsoft
Keyboard Microsoft
Software Windows 10 x64 Pro
I just placed order for a M.2 NVMe for my C6H.. hope it will be really fast for windows and page file.
 

Nkd

Joined
Sep 15, 2007
Messages
364 (0.06/day)
OMG! what a deal breaker! Buy a server cpu if you need all the server features. lol
 
Joined
Jun 28, 2016
Messages
3,595 (1.16/day)
OMG! what a deal breaker! Buy a server cpu if you need all the server features. lol
RAID is not a server feature. It's used in consumer PCs, but more importantly in workstations. That is, if Threadripper is meant to be a workstation CPU (which is unlikely).

As you've said, it is servers where RAID becomes crucial. And the worst thing is that TR is an EPYC underneath. So will EPYC be able to boot from RAID?
 
Joined
Apr 10, 2013
Messages
302 (0.07/day)
Location
Michigan, USA
Processor AMD 1700X
Motherboard Crosshair VI Hero
Memory F4-3200C14D-16GFX
Video Card(s) GTX 1070
Storage 960 Pro
Display(s) PG279Q
Case HAF X
Power Supply Silencer MK III 850
Mouse Logitech G700s
Keyboard Logitech G105
Software Windows 10

Aquinus

Resident Wat-man
Joined
Jan 28, 2012
Messages
13,171 (2.79/day)
Location
Concord, NH, USA
System Name Apollo
Processor Intel Core i9 9880H
Motherboard Some proprietary Apple thing.
Memory 64GB DDR4-2667
Video Card(s) AMD Radeon Pro 5600M, 8GB HBM2
Storage 1TB Apple NVMe, 4TB External
Display(s) Laptop @ 3072x1920 + 2x LG 5k Ultrafine TB3 displays
Case MacBook Pro (16", 2019)
Audio Device(s) AirPods Pro, Sennheiser HD 380s w/ FIIO Alpen 2, or Logitech 2.1 Speakers
Power Supply 96w Power Adapter
Mouse Logitech MX Master 3
Keyboard Logitech G915, GL Clicky
Software MacOS 12.1
@hellrazor's quote applies. In Linux, there is absolutely nothing stopping me from using mdadm to do software raid for root. Basically, only the kernel needs to be outside the software RAID to get the system started, which means you could literally have something as simple as a flash drive to get you to be able to boot from a software raid array.
Silly Windows users.
 

newtekie1

Semi-Retired Folder
Joined
Nov 22, 2005
Messages
28,473 (4.08/day)
Location
Indiana, USA
Processor Intel Core i7 10850K@5.2GHz
Motherboard AsRock Z470 Taichi
Cooling Corsair H115i Pro w/ Noctua NF-A14 Fans
Memory 32GB DDR4-3600
Video Card(s) RTX 2070 Super
Storage 500GB SX8200 Pro + 8TB with 1TB SSD Cache
Display(s) Acer Nitro VG280K 4K 28"
Case Fractal Design Define S
Audio Device(s) Onboard is good enough for me
Power Supply eVGA SuperNOVA 1000w G3
Software Windows 10 Pro x64
This isn't SATA3. If 4x lanes of PCI-E 3.0 (which is ~3.84GB/s,) isn't enough for your boot drive, then you might as well just put everything you need into system memory.

:toast:

Thing is, a single NVMe drive theoretically could use all the bandwidth of a PCI-E 3.0 x4 link. So if you are RAIDing the boot drive for the purpose of increased speed, the x4 link to the chipset becomes the bottleneck. That is whole reason why we are moving towards connecting the drives directly to the CPUs.
 

Aquinus

Resident Wat-man
Joined
Jan 28, 2012
Messages
13,171 (2.79/day)
Location
Concord, NH, USA
System Name Apollo
Processor Intel Core i9 9880H
Motherboard Some proprietary Apple thing.
Memory 64GB DDR4-2667
Video Card(s) AMD Radeon Pro 5600M, 8GB HBM2
Storage 1TB Apple NVMe, 4TB External
Display(s) Laptop @ 3072x1920 + 2x LG 5k Ultrafine TB3 displays
Case MacBook Pro (16", 2019)
Audio Device(s) AirPods Pro, Sennheiser HD 380s w/ FIIO Alpen 2, or Logitech 2.1 Speakers
Power Supply 96w Power Adapter
Mouse Logitech MX Master 3
Keyboard Logitech G915, GL Clicky
Software MacOS 12.1
Thing is, a single NVMe drive theoretically could use all the bandwidth of a PCI-E 3.0 x4 link. So if you are RAIDing the boot drive for the purpose of increased speed, the x4 link to the chipset becomes the bottleneck. That is whole reason why we are moving towards connecting the drives directly to the CPUs.
We are talking about boot device here, aren't we? It's not like you can't do this after the machine has started. My point is for how edge-case this is, there are options to get around it that aren't unreasonable.
 
Top