• Welcome to TechPowerUp Forums, Guest! Please check out our forum guidelines for info related to our community.

MAINGEAR Introduces PRO AI Workstations Featuring aiDAPTIV+ For Cost-Effective Large Language Model Training

TheLostSwede

News Editor
Joined
Nov 11, 2004
Messages
16,193 (2.27/day)
Location
Sweden
System Name Overlord Mk MLI
Processor AMD Ryzen 7 7800X3D
Motherboard Gigabyte X670E Aorus Master
Cooling Noctua NH-D15 SE with offsets
Memory 32GB Team T-Create Expert DDR5 6000 MHz @ CL30-34-34-68
Video Card(s) Gainward GeForce RTX 4080 Phantom GS
Storage 1TB Solidigm P44 Pro, 2 TB Corsair MP600 Pro, 2TB Kingston KC3000
Display(s) Acer XV272K LVbmiipruzx 4K@160Hz
Case Fractal Design Torrent Compact
Audio Device(s) Corsair Virtuoso SE
Power Supply be quiet! Pure Power 12 M 850 W
Mouse Logitech G502 Lightspeed
Keyboard Corsair K70 Max
Software Windows 10 Pro
Benchmark Scores https://valid.x86.fr/yfsd9w
MAINGEAR, a leading provider of high-performance custom PC systems, and Phison, a global leader in NAND controllers and storage solutions, today unveiled groundbreaking MAINGEAR PRO AI workstations with Phison's aiDAPTIV+ technology. Specifically engineered to democratize Large Language Model (LLM) development and training for small and medium-sized businesses (SMBs), these ultra-powerful workstations incorporate aiDAPTIV+ technology to deliver supercomputer LLM training capabilities at a fraction of the cost of traditional AI training servers.

As the demand for large-scale generative AI models continues to surge and their complexity increases, the potential for LLMs also expands. However, this rapid advancement in LLM AI technology has led to a notable boost in hardware requirements, making model training cost-prohibitive and inaccessible for many small to medium businesses.




With aiDAPTIV+, MAINGEAR PRO AI workstations integrate caching SSDs to seamlessly optimize the execution of AI models within the limitations of available GPU and DRAM resources. This innovative approach reduces hardware requirements and costs, allowing MAINGEAR to deliver a powerful AI model training solution, up to Llama-2 70b, on a standard desktop PC footprint. More PRO AI workstations can be added to seamlessly increase training data size and reduce training time.

"MAINGEAR's PRO AI workstations, driven by Phison aiDAPTIV+, empower users with large language model AI training prowess without excessive costs. Our dedication to crafting highly capable yet budget-friendly solutions guarantees SMBs, universities, and research facilities a competitive advantage in an industry formerly restricted by multimillion-dollar investments," affirmed Wallace Santos, MAINGEAR's founder and CEO.

MAINGEAR PRO AI workstations with aiDAPTIV+ technology are poised to revolutionize the landscape for engineers crafting next-generation generative AI models. Here's why they're a game-changer:
  • Affordable Price Point: By reimagining the role hardware plays in LLM training, PRO AI workstations make LLM model training affordable and accessible to most SMBs.
  • Futureproof Technology: aiDAPTIV+ eliminates concerns over GPU and DRAM capacity limitations, ensuring longevity and adaptability.
  • Retain Control of Your Data: PRO AI workstations allow AI model training at the edge instead of the cloud, allowing customers to retain control and privacy compliance of their data.
  • Easy Upgradability: Designed with off-the-shelf components for seamless upgrades.
  • Compact Form Factor: Featuring a standard desktop tower PC design, powered by standard 110/120 VAC wall outlets, these workstations are ideal for small office spaces. (Also available in a 4U rackmount chassis)
  • Quiet Operation: A noise-dampening chassis and Noctua cooling components ensure cool and quiet performance.

"Phison is thrilled to join forces with MAINGEAR to bring our aiDAPTIV+ to market," said Michael Wu, GM & President of Phison Technology Inc. "With their dedication to excellence and innovation, MAINGEAR is the ideal collaborator to provide the industry with Phison's groundbreaking AI innovation. Our alliance symbolizes a major advancement in enhancing AI development and training accessible to the industry, further underscoring our joint commitment to spearheading cutting-edge innovation."

MAINGEAR PRO AI workstations are available in full tower and rackmount form factors and can be custom-ordered to fit customer needs and workspace setups. These workstations boast powerful Intel Xeon W7-3455 CPUs and can be configured with up to 1 TB of DDR5 memory, and up to 4x RTX 5000 Ada or 4x RTX 6000 Ada GPUs. These GPUs are supported by Phison aiDAPTIV+ caching SSDs and software, which enhance GPU VRAM expansion for seamless AI model training and execution.

MAINGEAR PRO AI workstations are also available as three expertly preconfigured systems, which include:
PRO AI: SHODAN 64 (MSRP: $28,000)
  • Chassis: Fractal Design Define 7 XL
  • GPU: 2x NVIDIA RTX 5000 Ada
  • CPU: Intel Xeon W7-3455
  • Cooling: Noctua NH-U12S DX-4677, Noctua Fan Kit
  • Motherboard: Supermicro X13SWA-TF
  • Memory: 512 GB Kingston Server Premier RAM (8x64)
  • OS: Linux - Ubuntu
  • OS Drive: 2 TB Gen 4 M.2 NVMe SSD
  • AI Kit: Phison aiDAPTIV+ Layer
  • Additional Storage: 16 TB Seagate Barracuda HDD
  • Power: 1600 W XPG Fusion 80+ Platinum
  • Warranty: 2-year MAINGEAR PRO Solutions Warranty

PRO AI: SHODAN 96 (MSRP: $37,000)
  • Chassis: Fractal Design Define 7 XL
  • GPU: 2x NVIDIA RTX 6000 Ada
  • CPU: Intel Xeon W7-3455
  • Cooling: Noctua NH-U12S DX-4677, Noctua Fan Kit
  • Motherboard: Supermicro X13SWA-TF
  • Memory: 512 GB Kingston Server Premier RAM (8x64)
  • OS: Linux - Ubuntu
  • OS Drive: 2 TB Gen 4 M.2 NVMe SSD
  • AI Kit: Phison aiDAPTIV+
  • Additional Storage: 16 TB Seagate IronWolf HDD
  • Power: 1600 W XPG Fusion 80+ Platinum
  • Warranty: 2-year MAINGEAR PRO Solutions Warranty

PRO AI: SHODAN 192 (MSRP: $60,000)
  • Chassis: Fractal Design Define 7 XL
  • GPU: 4x NVIDIA RTX 6000 Ada
  • CPU: Intel Xeon W7-3455
  • Cooling: Noctua NH-U12S DX-4677, Noctua Fan Kit
  • Motherboard: Supermicro X13SWA-TF
  • Memory: 512 GB Kingston Server Premier RAM (8x64)
  • OS: Linux - Ubuntu
  • OS Drive: 2 TB Gen 4 M.2 NVMe SSD
  • AI Kit: Phison aiDAPTIV+
  • Additional Storage: 16 TB Seagate IronWolf HDD
  • Power: 1600 W XPG Fusion 80+ Platinum
  • Warranty: 2-year MAINGEAR PRO Solutions Warranty

View at TechPowerUp Main Site | Source
 
Joined
Jul 15, 2020
Messages
981 (0.70/day)
System Name Dirt Sheep | Silent Sheep
Processor i5-2400 | 13900K (-0.025mV offset)
Motherboard Asus P8H67-M LE | Gigabyte AERO Z690-G, bios F26 with "Instant 6 GHz" on
Cooling Scythe Katana Type 1 | Noctua NH-U12A chromax.black
Memory G-skill 2*8GB DDR3 | Corsair Vengeance 4*32GB DDR5 5200Mhz C40 @4000MHz
Video Card(s) Gigabyte 970GTX Mini | NV 1080TI FE (cap at 85%, 800mV)
Storage 2*SN850 1TB, 230S 4TB, 840EVO 128GB, WD green 2TB HDD, IronWolf 6TB, 2*HC550 18TB in RAID1
Display(s) LG 21` FHD W2261VP | Lenovo 27` 4K Qreator 27
Case Thermaltake V3 Black|Define 7 Solid, stock 3*14 fans+ 2*12 front&buttom+ out 1*8 (on expansion slot)
Audio Device(s) Beyerdynamic DT 990 (or the screen speakers when I'm too lazy)
Power Supply Enermax Pro82+ 525W | Corsair RM650x (2021)
Mouse Logitech Master 3
Keyboard Roccat Isku FX
VR HMD Nop.
Software WIN 10 | WIN 11
Benchmark Scores CB23 SC: i5-2400=641 | i9-13900k=2325-2281 MC: i5-2400=i9 13900k SC | i9-13900k=37240-35500
AI this, AI that. The AI buzz word hype is in full all in throttle…

P.S
Just a meaningless side note notice- Both Maingear and Puget systems use the same Define 7 solid as a case and use all Noctua fans and cooling components ;)
Makes me feel like a “pro” myself, as an owner of that case as well and cooling solution myself.
:rolleyes:
 
Joined
Jul 12, 2017
Messages
32 (0.01/day)
System Name ROU-Think-Fast
Processor AMD Ryzen 7 5800X
Motherboard B550 AORUS PRO V2 (rev. 1.0)
Cooling Custom (2 x Alphacool NexXxoS XT45, front/top, Alphacool Eisblock Aurora Acryl GPX-N RTX 3090/3080 )
Memory 4x8 GB Kingston Hyper X KHX3466C16D4/8GX (B-Die) @ 3600, C16-16-16-32
Video Card(s) RTX 3080 10GB
Storage ADATA SX8200 Pro 1 TB
Display(s) Acer Predator XB271HU
Case Fractal Design Meshify 2
Power Supply EVGA 750W Gold
That's a nice case for keeping a machine quiet. Having owned a similar Fractal model, I have my reservations as to how good it will be at keeping the 4 x 300W RTX 6000s fed with fresh air.
 
Top