Friday, March 21st 2025

NVMe Hard Drives: Seagate's Answer to Growing AI Storage Demands
Seagate is advancing in NVMe technology for large-capacity hard drives as the growing storage needs in AI systems and apps continue to rise. Old and current storage setups struggle to handle the huge datasets needed for machine learning, which now reach petabyte and even exabyte sizes. Today's storage options have many drawbacks for AI tasks. SSD-based systems offer the needed speed however it is not cost-effective for storing large AI training data. SAS/SATA hard drives are cheaper however, the interfaces rely on proprietary silicon, host bus adapters (HBAs), and controller architectures that struggle with the high-throughput, low-latency needs of AI's high data flow.
Seagate's "new idea" is to use NVMe technology in large-capacity hard drives. This creates a solution that keeps hard drives cost-effective and dense while boosting performance for AI apps. NVMe hard drives will not need HBAs, protocol bridges, and additional SAS infrastructure, allowing seamless scalability by integrating high-density hard drive storage with high-speed SSD caching in a unified NVMe architecture.Moreover, NVMe hard drives offer several benefits. They're easy to set up without special controllers, and they can be mixed with SSDs using a single NVMe driver and OS stack. Another advantage is the support for direct data transfer from GPU to storage using data processing units (DPUs), which avoids CPU bottlenecks. Also, NVMe over Fabrics (NVMe-oF) allows NVMe hard drives to integrate into distributed AI storage architectures.
To test this technology, Seagate ran a proof of concept (POC) integrating NVMe hard drives, NVMe SSDs, NVIDIA BlueField DPUs, and AIStore software (8x NVMe hard drives and 4x NVMe SSDs, all directly connected to NVIDIA's BlueField 3 DPU). The results showed a lower storage-related latency, a simplified infrastructure setup, better caching, and storage scalability. Seagate demonstrated that NVMe hard drives don't just work better. They're also much greener. They use ten times less embodied carbon per terabyte and four times less power than SSDs. Plus, they cost way less per terabyte.
Sources:
ITHome, Seagate Blog
Seagate's "new idea" is to use NVMe technology in large-capacity hard drives. This creates a solution that keeps hard drives cost-effective and dense while boosting performance for AI apps. NVMe hard drives will not need HBAs, protocol bridges, and additional SAS infrastructure, allowing seamless scalability by integrating high-density hard drive storage with high-speed SSD caching in a unified NVMe architecture.Moreover, NVMe hard drives offer several benefits. They're easy to set up without special controllers, and they can be mixed with SSDs using a single NVMe driver and OS stack. Another advantage is the support for direct data transfer from GPU to storage using data processing units (DPUs), which avoids CPU bottlenecks. Also, NVMe over Fabrics (NVMe-oF) allows NVMe hard drives to integrate into distributed AI storage architectures.
To test this technology, Seagate ran a proof of concept (POC) integrating NVMe hard drives, NVMe SSDs, NVIDIA BlueField DPUs, and AIStore software (8x NVMe hard drives and 4x NVMe SSDs, all directly connected to NVIDIA's BlueField 3 DPU). The results showed a lower storage-related latency, a simplified infrastructure setup, better caching, and storage scalability. Seagate demonstrated that NVMe hard drives don't just work better. They're also much greener. They use ten times less embodied carbon per terabyte and four times less power than SSDs. Plus, they cost way less per terabyte.
Compared to SSDs, NVMe hard drives would offer:Seagate has big plans as they want to make their Mozaic platform support more than the current 36 TB drives. They plan to improve NVMe over Fabrics (NVMe-oF) support and are currently working with their customers and partners to explore how NVMe hard drives can fit into next-generation AI storage solutions. Seagate admits that HDDs can't compete with solid-state drives when it comes to pure speed. However, their upgraded NVMe HDDs can provide a more efficient storage option for next-gen data centers.
- 10× more efficient embodied carbon per terabyte, significantly reducing environmental impact.
- 4× more efficient operating power consumption per terabyte, lowering AI data center energy costs.
- Significantly lower cost per terabyte, reducing AI storage TCO at scale.
7 Comments on NVMe Hard Drives: Seagate's Answer to Growing AI Storage Demands
Unless they are benching against optane or something, I'm calling BS on that "greener than SSDs" claim.
I wonder if NVMe Optical drives exist. :laugh: