• Welcome to TechPowerUp Forums, Guest! Please check out our forum guidelines for info related to our community.

AMD X399 Platform Lacks NVMe RAID Booting Support

btarunr

Editor & Senior Moderator
Staff member
Joined
Oct 9, 2007
Messages
47,308 (7.52/day)
Location
Hyderabad, India
System Name RBMK-1000
Processor AMD Ryzen 7 5700G
Motherboard ASUS ROG Strix B450-E Gaming
Cooling DeepCool Gammax L240 V2
Memory 2x 8GB G.Skill Sniper X
Video Card(s) Palit GeForce RTX 2080 SUPER GameRock
Storage Western Digital Black NVMe 512GB
Display(s) BenQ 1440p 60 Hz 27-inch
Case Corsair Carbide 100R
Audio Device(s) ASUS SupremeFX S1220A
Power Supply Cooler Master MWE Gold 650W
Mouse ASUS ROG Strix Impact
Keyboard Gamdias Hermes E2
Software Windows 11 Pro
AMD's connectivity-rich Ryzen Threadripper HEDT platform may have an Achilles's heel after all, with reports emerging that it lacks support for booting from NVMe RAID. You can still have bootable NVMe RAID volumes using NVMe RAID HBAs installed as PCI-Express add-on cards. Threadripper processors feature 64-lane PCI-Express gen 3.0 root complexes, which allow you to run at least two graphics cards at full x16 bandwidth, and drop in other bandwidth-hungry devices such as multiple PCI-Express NVMe SSDs. Unfortunately for those planning on striping multiple NVMe SSDs in RAID; the platform lacks NVMe RAID booting support. You should still be able to build soft-RAID arrays striping multiple NVMe SSDs, just not boot from them. Pro-sumers will still be able to dump their heavy data-sets onto such soft-arrays. This limitation is probably due to PCI-Express lanes emerging from different dies on the Threadripper MCM, which could present problems to the system BIOS to boot from.

Ryzen Threadripper is a multi-chip module (MCM) of two 8-core "Summit Ridge" dies. Each 14 nm "Summit Ridge" die features 32 PCI-Express lanes. On a socket AM4 machine, 4 of those 32 lanes are used as chipset-bus, leaving 28 for the rest of the machine. 16 of those head to up to two PEG (PCI-Express Graphics) ports (either one x16 or two x8 slots); and the remaining 12 lanes are spread among M.2 slots, and other onboard devices. On a Threadripper MCM, one of the two "Summit Ridge" dies has chipset-bus access; 16 lanes from each die head to PEG (a total of four PEG ports, either as two x16 or four x8 slots); while the remaining are general purpose; driving high-bandwidth devices such as USB 3.1 controllers, 10 GbE interfaces, and several M.2 and U.2 ports.



There is always the likelihood of two M.2/U.2 ports being wired to different "Summit Ridge" dies; which could pose issues in getting RAID to work reliably, which is probably the reason why NVMe RAID booting won't work. The X399 chipset, however, does support RAID on the SATA ports it puts out. Up to four SATA 6 Gb/s ports on a socket TR4 motherboard can be wired directly to the processor, as each "Summit Ridge" puts out two ports. This presents its own set of RAID issues. The general rule of the thumb here is that you'll be able to create bootable RAID arrays only between disks connected to the same exact SATA controller. By default, you have three controllers - one from each of the two "Summit Ridge" dies, and one integrated into the X399 chipset. The platform supports up to 10 ports. You will hence be able to boot from SATA RAID arrays, provided they're built up from the same controller; however, booting from NVMe RAID arrays will not be possible.

View at TechPowerUp Main Site
 
Last edited:
Joined
Nov 29, 2016
Messages
671 (0.23/day)
System Name Unimatrix
Processor Intel i9-9900K @ 5.0GHz
Motherboard ASRock x390 Taichi Ultimate
Cooling Custom Loop
Memory 32GB GSkill TridentZ RGB DDR4 @ 3400MHz 14-14-14-32
Video Card(s) EVGA 2080 with Heatkiller Water Block
Storage 2x Samsung 960 Pro 512GB M.2 SSD in RAID 0, 1x WD Blue 1TB M.2 SSD
Display(s) Alienware 34" Ultrawide 3440x1440
Case CoolerMaster P500M Mesh
Power Supply Seasonic Prime Titanium 850W
Keyboard Corsair K75
Benchmark Scores Really Really High
This sucks. I was planning to RAID 0 my two NVMe drives I bought for this platform.

So much speculation you added to this article.

You forgot this part from the Tom's Hardware article:
"We were also told that AMD is going to enable the feature, but there isn't a firm timeline. It's one thing to talk about booting from an array of speedy next-generation storage devices that can surpass 5,000MB/s with just two drives; it's another thing to actually deliver.
 
Last edited:
D

Deleted member 172152

Guest
How's that an achilles heel? Threadripper isn't for high-end servers/workstations that need booting from raid anyway. Just get an extra 60gb ssd for windows if you really want crazy raid setups as your main storage! Simple.
 
Joined
Dec 14, 2011
Messages
91 (0.02/day)
Location
Deadmonton
System Name Prime Shiz
Processor Intel i7 4770K 4.4Ghz 1.31v
Motherboard MSI Z97A Gaming 6
Cooling Noctua NH-D14
Memory G.Skill Ripjaws X 1866MHz 16GB @ 2200 CL10
Video Card(s) MSI GTX1070 GAMING X 8GB
Storage Crucial BX100 250GB, Corsair Force 3 240GB, Crucial BX100 500GB
Display(s) Asus VS24AH-P
Case Silverstone Fortress FT02 USB3.0
Audio Device(s) Asus Xonar Essense STX
Power Supply EVGA SuperNOVA 650 G2
Mouse Mionix Naos 3200
Keyboard CM Storm Quickfire TK reds
Oh the horror! But seriously, does anyone here actually boot off multiple NVMe SSD's? Seems a bit ridiculous with the speed those already provide.
 
Joined
Dec 31, 2009
Messages
19,372 (3.54/day)
Benchmark Scores Faster than yours... I'd bet on it. :)
How's that an achilles heel? Threadripper isn't for high-end servers/workstations that need booting from raid anyway. Just get an extra 60gb ssd for windows if you really want crazy raid setups as your main storage! Simple.
these are workstation/prosumer class cpus (what are you going to buy these and primarily game?? Wth???).

There is a small market for such a thing... and it is quite a surpise it cant. Intel can on x299, i believe even with 28 lane cpus too. ;)
 
Joined
Jul 12, 2013
Messages
202 (0.05/day)
Processor Intel Core i9-13900K
Motherboard ASUS ProArt Z690-CREATOR WIFI
Cooling Custom water
Memory G.Skill Trident Z5 RGB 32GB DDR5-6400 CL32
Video Card(s) Dell RTX 4090
Storage Sabrent 1TB Rocket 4 Plus
Display(s) MSI MAG 321UPX
Case Fractal Design Meshify 2 XL (Dark Tint)
Power Supply SAMA XP1000W
Mouse DAREU EM901
Keyboard RK ROYAL KLUDGE RK100 (white with blue switches)
I was kind of sad when I heard this news a few days ago but then thought, you know software RAID is practically just as good and you can transfer the RAID array across multiple platforms.
 
Joined
Nov 4, 2005
Messages
12,019 (1.72/day)
System Name Compy 386
Processor 7800X3D
Motherboard Asus
Cooling Air for now.....
Memory 64 GB DDR5 6400Mhz
Video Card(s) 7900XTX 310 Merc
Storage Samsung 990 2TB, 2 SP 2TB SSDs, 24TB Enterprise drives
Display(s) 55" Samsung 4K HDR
Audio Device(s) ATI HDMI
Mouse Logitech MX518
Keyboard Razer
Software A lot.
Benchmark Scores Its fast. Enough.
Any thoughts on how it would handle dedicated RAID hardware? It really shouldn't matter with DMA.
 

TheLostSwede

News Editor
Joined
Nov 11, 2004
Messages
17,788 (2.42/day)
Location
Sweden
System Name Overlord Mk MLI
Processor AMD Ryzen 7 7800X3D
Motherboard Gigabyte X670E Aorus Master
Cooling Noctua NH-D15 SE with offsets
Memory 32GB Team T-Create Expert DDR5 6000 MHz @ CL30-34-34-68
Video Card(s) Gainward GeForce RTX 4080 Phantom GS
Storage 1TB Solidigm P44 Pro, 2 TB Corsair MP600 Pro, 2TB Kingston KC3000
Display(s) Acer XV272K LVbmiipruzx 4K@160Hz
Case Fractal Design Torrent Compact
Audio Device(s) Corsair Virtuoso SE
Power Supply be quiet! Pure Power 12 M 850 W
Mouse Logitech G502 Lightspeed
Keyboard Corsair K70 Max
Software Windows 10 Pro
Benchmark Scores https://valid.x86.fr/yfsd9w
Hmmm, this sounds more like a UEFI/driver issue than something that's impossible to do.
RAID requires UEFI/BIOS support, as well as potentially a driver, but it seems like AMD hasn't had the time to do this as yet. Not saying it'll happen, but even the Z170 platform wasn't perfect from day one and only supports RAID-0.
 

newtekie1

Semi-Retired Folder
Joined
Nov 22, 2005
Messages
28,473 (4.08/day)
Location
Indiana, USA
Processor Intel Core i7 10850K@5.2GHz
Motherboard AsRock Z470 Taichi
Cooling Corsair H115i Pro w/ Noctua NF-A14 Fans
Memory 32GB DDR4-3600
Video Card(s) RTX 2070 Super
Storage 500GB SX8200 Pro + 8TB with 1TB SSD Cache
Display(s) Acer Nitro VG280K 4K 28"
Case Fractal Design Define S
Audio Device(s) Onboard is good enough for me
Power Supply eVGA SuperNOVA 1000w G3
Software Windows 10 Pro x64
Honestly, I don't really see this as a deal breaker.

You can still create storage RAID arrays using NVMe, and put all your programs and games and datasets on that. And just run Windows off a SATA array, or heck a single NVMe drive.

And it isn't like Intel's X299 RAID situation is any better. You can only boot from NVMe raid if you use Intel branded SSDs. You can't do anything other than RAID-0(so nothing redundant) unless you buy a special dongle to plug into the motherboard to enable those features(and I'm sure that dongle ain't going to be cheap).
 
Joined
Dec 31, 2009
Messages
19,372 (3.54/day)
Benchmark Scores Faster than yours... I'd bet on it. :)
I dont think its intel branded only...there are keys one needs to buy(annoying!!) that plug into the motherboard...
 
Joined
Nov 29, 2016
Messages
671 (0.23/day)
System Name Unimatrix
Processor Intel i9-9900K @ 5.0GHz
Motherboard ASRock x390 Taichi Ultimate
Cooling Custom Loop
Memory 32GB GSkill TridentZ RGB DDR4 @ 3400MHz 14-14-14-32
Video Card(s) EVGA 2080 with Heatkiller Water Block
Storage 2x Samsung 960 Pro 512GB M.2 SSD in RAID 0, 1x WD Blue 1TB M.2 SSD
Display(s) Alienware 34" Ultrawide 3440x1440
Case CoolerMaster P500M Mesh
Power Supply Seasonic Prime Titanium 850W
Keyboard Corsair K75
Benchmark Scores Really Really High
I was kind of sad when I heard this news a few days ago but then thought, you know software RAID is practically just as good and you can transfer the RAID array across multiple platforms.

You can't boot off of software raid.
 
Joined
Nov 29, 2016
Messages
671 (0.23/day)
System Name Unimatrix
Processor Intel i9-9900K @ 5.0GHz
Motherboard ASRock x390 Taichi Ultimate
Cooling Custom Loop
Memory 32GB GSkill TridentZ RGB DDR4 @ 3400MHz 14-14-14-32
Video Card(s) EVGA 2080 with Heatkiller Water Block
Storage 2x Samsung 960 Pro 512GB M.2 SSD in RAID 0, 1x WD Blue 1TB M.2 SSD
Display(s) Alienware 34" Ultrawide 3440x1440
Case CoolerMaster P500M Mesh
Power Supply Seasonic Prime Titanium 850W
Keyboard Corsair K75
Benchmark Scores Really Really High
Honestly, I don't really see this as a deal breaker.

You can still create storage RAID arrays using NVMe, and put all your programs and games and datasets on that. And just run Windows off a SATA array, or heck a single NVMe drive.

And it isn't like Intel's X299 RAID situation is any better. You can only boot from NVMe raid if you use Intel branded SSDs. You can't do anything other than RAID-0(so nothing redundant) unless you buy a special dongle to plug into the motherboard to enable those features(and I'm sure that dongle ain't going to be cheap).

Not true. It works with all NVMe drives.
 
Joined
Feb 13, 2009
Messages
350 (0.06/day)
Location
NYC
Processor Intel Core i7 8700K
Motherboard ROG STRIX Z370-G GAMING AC
Cooling Corsair H115i Pro RGB
Memory G.Skill Trident Z RGB 16GB DDR4 3200Mhz
Video Card(s) Gigabyte GTX 1070 G1
Storage Samsung 970 Evo 500GB
Display(s) Dell S2417DG 165Hz
Case NZXT H400i
Power Supply Corsair AX760
Mouse Razer Deathadder Chroma
Keyboard Cooler Master - Masterkeys Pro L RGB
Software Windows 10 Pro 64Bit
Honestly, I don't really see this as a deal breaker.

You can still create storage RAID arrays using NVMe, and put all your programs and games and datasets on that. And just run Windows off a SATA array, or heck a single NVMe drive.

And it isn't like Intel's X299 RAID situation is any better. You can only boot from NVMe raid if you use Intel branded SSDs. You can't do anything other than RAID-0(so nothing redundant) unless you buy a special dongle to plug into the motherboard to enable those features(and I'm sure that dongle ain't going to be cheap).

You don't need any keys/dongles to have a bootable raid 1 or 0 nvme raid configuration on x299 with ANY nvme drive.
Vroc is a different feature.
 
Joined
Nov 5, 2014
Messages
714 (0.19/day)
Oh the horror! But seriously, does anyone here actually boot off multiple NVMe SSD's? Seems a bit ridiculous with the speed those already provide.

I never even considered RAIDing mine, why add that extra point of failure when you would need a benchmark tool to see any gains that are irrelevant in the real world lol.
 
Joined
Oct 2, 2004
Messages
13,791 (1.87/day)
It's why I've gone with SATA3 drive in the first place. Entirely unobtainable 2TB M.2's at the time. It hasn't improved much almost 2 years later.
 
Joined
Apr 10, 2013
Messages
302 (0.07/day)
Location
Michigan, USA
Processor AMD 1700X
Motherboard Crosshair VI Hero
Memory F4-3200C14D-16GFX
Video Card(s) GTX 1070
Storage 960 Pro
Display(s) PG279Q
Case HAF X
Power Supply Silencer MK III 850
Mouse Logitech G700s
Keyboard Logitech G105
Software Windows 10
I lean a little bull on Intel and critical on AMD. This story however is a big nothing. The whole point of nvme is/was to create a new interface/protocol that advances the old queue and command limits of SATA. It also benefited from increasing PCIe allocation. RAID is not necessary - right now you can have a drive capable of 3500/2100 sequential and 65/200 single thread 4k, 1700/1200 4k at higher depths. This is more than 99% of the market can even use and that other 1% is just bench/wank.
 
Joined
Sep 25, 2012
Messages
2,074 (0.46/day)
Location
Jacksonhole Florida
System Name DEVIL'S ABYSS
Processor i7-4790K@4.6 GHz
Motherboard Asus Z97-Deluxe
Cooling Corsair H110 (2 x 140mm)(3 x 140mm case fans)
Memory 16GB Adata XPG V2 2400MHz
Video Card(s) EVGA 780 Ti Classified
Storage Intel 750 Series 400GB (AIC), Plextor M6e 256GB (M.2), 13 TB storage
Display(s) Crossover 27QW (27"@ 2560x1440)
Case Corsair Obsidian 750D Airflow
Audio Device(s) Realtek ALC1150
Power Supply Cooler Master V1000
Mouse Ttsports Talon Blu
Keyboard Logitech G510
Software Windows 10 Pro x64 version 1803
Benchmark Scores Passmark CPU score = 13080
You don't need any keys/dongles to have a bootable raid 1 or 0 nvme raid configuration on x299 with ANY nvme drive.
Vroc is a different feature.
Virtual Raid-on-CPU must be confusing to some people, they use it to point out how evil Intel is "making us" buy an expensive key just to boot from RAID and that the drives have to be Intel. I believe they call that "grasping at straws" and spreading misinformation.
 
Joined
Dec 15, 2006
Messages
1,703 (0.26/day)
Location
Oshkosh, WI
System Name ChoreBoy
Processor 8700k Delided
Motherboard Gigabyte Z390 Master
Cooling 420mm Custom Loop
Memory CMK16GX4M2B3000C15 2x8GB @ 3000Mhz
Video Card(s) EVGA 1080 SC
Storage 1TB SX8200, 250GB 850 EVO, 250GB Barracuda
Display(s) Pixio PX329 and Dell E228WFP
Case Fractal R6
Audio Device(s) On-Board
Power Supply 1000w Corsair
Software Win 10 Pro
Benchmark Scores A million on everything....
Oh the horror! But seriously, does anyone here actually boot off multiple NVMe SSD's? Seems a bit ridiculous with the speed those already provide.
Yeah... at what point am I going to have time to pour a coffee if I've got a bootable RAID nVME setup? Lol.
Still, seems odd that it's not working, but then I guess we gotta settle at some point.
 
Joined
Mar 6, 2017
Messages
3,358 (1.18/day)
Location
North East Ohio, USA
System Name My Ryzen 7 7700X Super Computer
Processor AMD Ryzen 7 7700X
Motherboard Gigabyte B650 Aorus Elite AX
Cooling DeepCool AK620 with Arctic Silver 5
Memory 2x16GB G.Skill Trident Z5 NEO DDR5 EXPO (CL30)
Video Card(s) XFX AMD Radeon RX 7900 GRE
Storage Samsung 980 EVO 1 TB NVMe SSD (System Drive), Samsung 970 EVO 500 GB NVMe SSD (Game Drive)
Display(s) Acer Nitro XV272U (DisplayPort) and Acer Nitro XV270U (DisplayPort)
Case Lian Li LANCOOL II MESH C
Audio Device(s) On-Board Sound / Sony WH-XB910N Bluetooth Headphones
Power Supply MSI A850GF
Mouse Logitech M705
Keyboard Steelseries
Software Windows 11 Pro 64-bit
Benchmark Scores https://valid.x86.fr/liwjs3
I really don't see this as a problem. OK, so your boot M.2 drive may not be able to be RAIDed but who cares? Just so long as your project drive setup can be RAIDed.
 
Joined
Jun 28, 2017
Messages
8 (0.00/day)
doesn't really matter, software RAID is now comparable in perf and better than cheap onboard hardware RAID.
go do your benches and you'll see, hardware RAID on consumer boards is just a feature sale when in reality if you really want RAID then go get a proper HBA. This is really a non-topic for AMD architecture when their CPUs perform better and at a lower price point than Intels beasts especially in prosumer markets.
 
Joined
Dec 31, 2009
Messages
19,372 (3.54/day)
Benchmark Scores Faster than yours... I'd bet on it. :)
Software raid doesnt travel well outside of the chipset though. Hw raid can go wherever the card goes.
 
Joined
Apr 12, 2013
Messages
7,563 (1.77/day)
these are workstation/prosumer class cpus (what are you going to buy these and primarily game?? Wth???).

There is a small market for such a thing... and it is quite a surpise it cant. Intel can on x299, i believe even with 28 lane cpus too. ;)
But I thought you didn;t RAID (0) production machine boot drives?
Anyway get the fastest NVMe out there, sure it;s a PITA for existing users but like I said for reliability purposes, I'm told, you don;t raid your work machines, unless of course it's RAID 1, 5, 10 et al.
 
Joined
Nov 3, 2013
Messages
2,141 (0.53/day)
Location
Serbia
Processor Ryzen 5600
Motherboard X570 I Aorus Pro
Cooling Deepcool AG400
Memory HyperX Fury 2 x 8GB 3200 CL16
Video Card(s) RX 6700 10GB SWFT 309
Storage SX8200 Pro 512 / NV2 512
Display(s) 24G2U
Case NR200P
Power Supply Ion SFX 650
Mouse G703 (TTC Gold 60M)
Keyboard Keychron V1 (Akko Matcha Green) / Apex m500 (Gateron milky yellow)
Software W10
Looks to me it's nothing an uefi update can't solve.
 
Joined
Feb 18, 2010
Messages
1,850 (0.34/day)
System Name Eldritch
Processor AMD Ryzen 5 5800X3D
Motherboard ASUS TUF X570 Pro Wifi
Cooling Satan's butthole after going to Taco Bell
Memory 64 GB G.Skill TridentZ
Video Card(s) Vega 56
Storage 6*8TB Western Digital Blues in RAID 6, 2*512 GB Samsung 960 Pros
Display(s) Acer CB281HK
Case Phanteks Enthoo Pro PH-ES614P_BK
Audio Device(s) ASUS Xonar DX
Power Supply EVGA Supernova 750 G2
Mouse Razer Viper 8K
Software Debian Bullseye

cdawall

where the hell are my stars
Joined
Jul 23, 2006
Messages
27,680 (4.11/day)
Location
Houston
System Name All the cores
Processor 2990WX
Motherboard Asrock X399M
Cooling CPU-XSPC RayStorm Neo, 2x240mm+360mm, D5PWM+140mL, GPU-2x360mm, 2xbyski, D4+D5+100mL
Memory 4x16GB G.Skill 3600
Video Card(s) (2) EVGA SC BLACK 1080Ti's
Storage 2x Samsung SM951 512GB, Samsung PM961 512GB
Display(s) Dell UP2414Q 3840X2160@60hz
Case Caselabs Mercury S5+pedestal
Audio Device(s) Fischer HA-02->Fischer FA-002W High edition/FA-003/Jubilate/FA-011 depending on my mood
Power Supply Seasonic Prime 1200w
Mouse Thermaltake Theron, Steam controller
Keyboard Keychron K8
Software W10P
these are workstation/prosumer class cpus (what are you going to buy these and primarily game?? Wth???).

There is a small market for such a thing... and it is quite a surpise it cant. Intel can on x299, i believe even with 28 lane cpus too. ;)

Those are driven by the chipset not the cpu lanes though right?

This is disappointing for me I have 3 512gb nvme drives I want to use.
 
Top