• Welcome to TechPowerUp Forums, Guest! Please check out our forum guidelines for info related to our community.

Announcing Fungible GPU-Connect - Connect Any GPU to Any Server Over Ethernet

TheLostSwede

News Editor
Joined
Nov 11, 2004
Messages
17,358 (2.38/day)
Location
Sweden
System Name Overlord Mk MLI
Processor AMD Ryzen 7 7800X3D
Motherboard Gigabyte X670E Aorus Master
Cooling Noctua NH-D15 SE with offsets
Memory 32GB Team T-Create Expert DDR5 6000 MHz @ CL30-34-34-68
Video Card(s) Gainward GeForce RTX 4080 Phantom GS
Storage 1TB Solidigm P44 Pro, 2 TB Corsair MP600 Pro, 2TB Kingston KC3000
Display(s) Acer XV272K LVbmiipruzx 4K@160Hz
Case Fractal Design Torrent Compact
Audio Device(s) Corsair Virtuoso SE
Power Supply be quiet! Pure Power 12 M 850 W
Mouse Logitech G502 Lightspeed
Keyboard Corsair K70 Max
Software Windows 10 Pro
Benchmark Scores https://valid.x86.fr/yfsd9w
Fungible, Inc., the composable infrastructure company, today announced a new product offering, Fungible GPU-Connect (FGC ), an innovative solution engineered to revolutionize how data processing power is accessed in enterprise and service provider infrastructures. Fungible GPU-Connect solves the challenges caused by the growing demand for AI/ML, especially in Edge Data Centers with stranded and underutilized GPUs. FGC leverages the Fungible DPU to dynamically compose GPU and CPU resources across an Ethernet network. This provides significant economic benefits and agility to organizations that provision, allocate, and manage expensive GPU resources. For the first time, organizations can create a GPU-powered infrastructure free from the physical limitations of PCIe.

FGC allows data centers to centralize their existing GPU assets into a single resource pool to be attached to servers on demand. Instead of dedicated GPUs sitting idle most of the time, data centers can provide new users with access to the GPU pool, making greater use of existing assets. This disaggregated solution also removes the constraints of having GPUs and CPUs physically co-located. They can be located anywhere within the same data center, eliminating the stranding of expensive GPU resources. The Fungible DPU creates a secure, virtual PCIe connection between the GPU and the server that is transparent to the server and to applications - no special software or drivers are needed. This connection is managed in hardware by the DPU, ensuring a high-performance and low latency connection. This transparency means FGC can be easily retrofitted into existing environments, and can scale with growing demand, ensuring GPUs are always available when they are needed.




"Fungible GPU-Connect empowers service providers to combine all their GPUs into one central resource pool serving all their clients. Service providers can now onboard new data-analysis intensive clients quickly without adding expensive servers and GPUs," explains Toby Owen, VP of Product at Fungible. "By leveraging FGC, data centers can benefit from the collective computing power of all their GPUs and substantially lower their TCO with the reduction of GPU resources, cooling and physical footprint needed."

With FGC, service providers can differentiate themselves and create net-new revenue opportunities by offering their customers more flexible plans and the specialized performance of GPU servers that are in high demand.

"GPUs are needed for service providers who are increasingly getting into AI/ML processing. Composable infrastructure supports the agility they need to successfully monetize these expensive resources," said Eric Burgener, Vice President of Research, Infrastructure Systems, Platforms and Technologies Group, IDC. "Products like Fungible GPU-Connect enable service providers to cost-effectively make GPUs available to their customers, rapidly provisioning requested resources to meet customer requirements on-demand while easily sharing these expensive resources across multiple customers to drive a higher return on investment."

View at TechPowerUp Main Site | Source
 
Joined
Nov 4, 2005
Messages
11,947 (1.73/day)
System Name Compy 386
Processor 7800X3D
Motherboard Asus
Cooling Air for now.....
Memory 64 GB DDR5 6400Mhz
Video Card(s) 7900XTX 310 Merc
Storage Samsung 990 2TB, 2 SP 2TB SSDs, 24TB Enterprise drives
Display(s) 55" Samsung 4K HDR
Audio Device(s) ATI HDMI
Mouse Logitech MX518
Keyboard Razer
Software A lot.
Benchmark Scores Its fast. Enough.
So they add Fungible to their name and PR and just sell GPU time on a server….

Bold move cotton, lets see if they have the security and enough people fall for it
 
Joined
Aug 20, 2007
Messages
21,330 (3.40/day)
System Name Pioneer
Processor Ryzen R9 9950X
Motherboard GIGABYTE Aorus Elite X670 AX
Cooling Noctua NH-D15 + A whole lotta Sunon and Corsair Maglev blower fans...
Memory 64GB (4x 16GB) G.Skill Flare X5 @ DDR5-6000 CL30
Video Card(s) XFX RX 7900 XTX Speedster Merc 310
Storage Intel 905p Optane 960GB boot, +2x Crucial P5 Plus 2TB PCIe 4.0 NVMe SSDs
Display(s) 55" LG 55" B9 OLED 4K Display
Case Thermaltake Core X31
Audio Device(s) TOSLINK->Schiit Modi MB->Asgard 2 DAC Amp->AKG Pro K712 Headphones or HDMI->B9 OLED
Power Supply FSP Hydro Ti Pro 850W
Mouse Logitech G305 Lightspeed Wireless
Keyboard WASD Code v3 with Cherry Green keyswitches + PBT DS keycaps
Software Gentoo Linux x64 / Windows 11 Enterprise IoT 2024
So they add Fungible to their name and PR and just sell GPU time on a server….
It sounds like it's actually a protocol to manage a gpu over ethernet, or am I wrong?

Bold move cotton, lets see if they have the security and enough people fall for it
One of my early businesses was a "computational consulting" group that rented GPU time. There was demand even before bitcoin. Of course crypto made it take off in a big way. My early clients were largely running some types of large compute workload, probably password cracking/recovery with rainbow tables.

I could really have used something like they describe.
 
Joined
Sep 1, 2009
Messages
1,229 (0.22/day)
Location
CO
System Name 4k
Processor AMD 5800x3D
Motherboard MSI MAG b550m Mortar Wifi
Cooling ARCTIC Liquid Freezer II 240
Memory 4x8Gb Crucial Ballistix 3600 CL16 bl8g36c16u4b.m8fe1
Video Card(s) Nvidia Reference 3080Ti
Storage ADATA XPG SX8200 Pro 1TB
Display(s) LG 48" C1
Case CORSAIR Carbide AIR 240 Micro-ATX
Audio Device(s) Asus Xonar STX
Power Supply EVGA SuperNOVA 650W
Software Microsoft Windows10 Pro x64
It sounds like it's actually a protocol to manage a gpu over ethernet, or am I wrong?
I watched a video from Patrick at Serve the Home that went over DPUs and kind of eluded to this. DPU's manage server resources over ethernet from multiple nodes.
 

Mussels

Freshwater Moderator
Joined
Oct 6, 2004
Messages
58,413 (7.98/day)
Location
Oystralia
System Name Rainbow Sparkles (Power efficient, <350W gaming load)
Processor Ryzen R7 5800x3D (Undervolted, 4.45GHz all core)
Motherboard Asus x570-F (BIOS Modded)
Cooling Alphacool Apex UV - Alphacool Eisblock XPX Aurora + EK Quantum ARGB 3090 w/ active backplate
Memory 2x32GB DDR4 3600 Corsair Vengeance RGB @3866 C18-22-22-22-42 TRFC704 (1.4V Hynix MJR - SoC 1.15V)
Video Card(s) Galax RTX 3090 SG 24GB: Underclocked to 1700Mhz 0.750v (375W down to 250W))
Storage 2TB WD SN850 NVME + 1TB Sasmsung 970 Pro NVME + 1TB Intel 6000P NVME USB 3.2
Display(s) Phillips 32 32M1N5800A (4k144), LG 32" (4K60) | Gigabyte G32QC (2k165) | Phillips 328m6fjrmb (2K144)
Case Fractal Design R6
Audio Device(s) Logitech G560 | Corsair Void pro RGB |Blue Yeti mic
Power Supply Fractal Ion+ 2 860W (Platinum) (This thing is God-tier. Silent and TINY)
Mouse Logitech G Pro wireless + Steelseries Prisma XL
Keyboard Razer Huntsman TE ( Sexy white keycaps)
VR HMD Oculus Rift S + Quest 2
Software Windows 11 pro x64 (Yes, it's genuinely a good OS) OpenRGB - ditch the branded bloatware!
Benchmark Scores Nyooom.
My brain is melting but i like the concept if we can apply it to home use.
 
Top