• Welcome to TechPowerUp Forums, Guest! Please check out our forum guidelines for info related to our community.

NVIDIA Cracks Down on CUDA Translation Layers, Changes Licensing Terms

Joined
Sep 6, 2013
Messages
3,328 (0.81/day)
Location
Athens, Greece
System Name 3 desktop systems: Gaming / Internet / HTPC
Processor Ryzen 5 5500 / Ryzen 5 4600G / FX 6300 (12 years latter got to see how bad Bulldozer is)
Motherboard MSI X470 Gaming Plus Max (1) / MSI X470 Gaming Plus Max (2) / Gigabyte GA-990XA-UD3
Cooling Νoctua U12S / Segotep T4 / Snowman M-T6
Memory 32GB - 16GB G.Skill RIPJAWS 3600+16GB G.Skill Aegis 3200 / 16GB JUHOR / 16GB Kingston 2400MHz (DDR3)
Video Card(s) ASRock RX 6600 + GT 710 (PhysX)/ Vega 7 integrated / Radeon RX 580
Storage NVMes, ONLY NVMes/ NVMes, SATA Storage / NVMe boot(Clover), SATA storage
Display(s) Philips 43PUS8857/12 UHD TV (120Hz, HDR, FreeSync Premium) ---- 19'' HP monitor + BlitzWolf BW-V5
Case Sharkoon Rebel 12 / CoolerMaster Elite 361 / Xigmatek Midguard
Audio Device(s) onboard
Power Supply Chieftec 850W / Silver Power 400W / Sharkoon 650W
Mouse CoolerMaster Devastator III Plus / CoolerMaster Devastator / Logitech
Keyboard CoolerMaster Devastator III Plus / CoolerMaster Devastator / Logitech
Software Windows 10 / Windows 10&Windows 11 / Windows 10
People will always figure out a way to circumvent a closed ecosystem. The only way to prevent this is by making those circumventions illegal via your EULA, aka protectionism, which inherently decreases the appeal of your ecosystem as fewer people can use it. And eventually, you'll step too far, and someone will challenge your EULA in court, and you'll lose. This is exactly what has happened to Apple - after being allowed to dictate exactly how people use its products for far too long, the EU has finally stepped up to enforce consumers' rights. Court cases are bad for share prices, and especially bad if the company loses.

Therefore, closed ecosystems always ultimately fail, which means they are ultimately stupid. Expending massive amounts of effort in an attempt to protect them will ultimately fail, so this is also stupid.

The smart thing to do would be to start negotiating with other GPU vendors to come up with a shared open standard that just so happens to look a lot like CUDA, and just so happens to require very minimal translation from CUDA. Boom, you've immediately got a rung up on the competition because they have to expend way more effort to make their cards work with your not-CUDA. And because not-CUDA is so similar to CUDA and so easy to port over, users who are already using CUDA won't be unduly affected. As a bonus, because this standard is based on CUDA, NVIDIA would wield a lot of control over it - which is exactly what they want anyway.

Unfortunately, corporations rarely make logical decisions.
Depends. Depends on how much you gain from such an attitude until someone challenges you in court, fine you a couple of billions, or decides -as a consumer- to ditch you for a competitor. Depends on how much you have become a necessity. And right now, Apple and Nvidia can enforce restrictions, put whatever prices they like, ignore competition and fines, or those 2-3 consumers who decide to go to the competitor, while keep making billions and expanding their influence and their image of being a necessity and the only option.
This move from Nvidia will only favor Nvidia, because it wouldn't hurt CUDA in any way. CUDA has become something like the only option for many. Think Windows and Microsoft. Microsoft has done it's mistakes the last 25 years (like Vista or Win8) and in every mistake, people where expecting it will lose market share, with Linux being the winner. Well, in desktops and laptops it's only losing against another monopoly, Apple. Linux is still at low single digit. This move from Nvidia comes just a few days after that post from Herkelman saying that Nvidia is a cartel, showing that Nvidia doesn't really cares if people realize that it acts like a cartel. On the contrary.
 
Joined
Nov 26, 2021
Messages
1,642 (1.51/day)
Location
Mississauga, Canada
Processor Ryzen 7 5700X
Motherboard ASUS TUF Gaming X570-PRO (WiFi 6)
Cooling Noctua NH-C14S (two fans)
Memory 2x16GB DDR4 3200
Video Card(s) Reference Vega 64
Storage Intel 665p 1TB, WD Black SN850X 2TB, Crucial MX300 1TB SATA, Samsung 830 256 GB SATA
Display(s) Nixeus NX-EDG27, and Samsung S23A700
Case Fractal Design R5
Power Supply Seasonic PRIME TITANIUM 850W
Mouse Logitech
VR HMD Oculus Rift
Software Windows 11 Pro, and Ubuntu 20.04
X86 emulation is allowed. Emulation of X86 ISA extensions that are still under patent protection is allowed if you're Microsoft or Apple. Emulation of Arm ISA, for example - I don't know but Arm ISA is a major product they make money on, by selling it to architectural licence holders. QEMU is inefficient enough and Arm doesn't see it as a threat.
Even Transmeta was allowed to release processors that ran x86 code. Wine is a better example, and while Microsoft hampered it, they never sued anyone. When you are exceeding peak Microsoft levels of asshattery, you have to stop and think if what you're doing is right in the long run.
 
Joined
Aug 20, 2007
Messages
21,443 (3.40/day)
System Name Pioneer
Processor Ryzen R9 9950X
Motherboard GIGABYTE Aorus Elite X670 AX
Cooling Noctua NH-D15 + A whole lotta Sunon and Corsair Maglev blower fans...
Memory 64GB (4x 16GB) G.Skill Flare X5 @ DDR5-6000 CL30
Video Card(s) XFX RX 7900 XTX Speedster Merc 310
Storage Intel 905p Optane 960GB boot, +2x Crucial P5 Plus 2TB PCIe 4.0 NVMe SSDs
Display(s) 55" LG 55" B9 OLED 4K Display
Case Thermaltake Core X31
Audio Device(s) TOSLINK->Schiit Modi MB->Asgard 2 DAC Amp->AKG Pro K712 Headphones or HDMI->B9 OLED
Power Supply FSP Hydro Ti Pro 850W
Mouse Logitech G305 Lightspeed Wireless
Keyboard WASD Code v3 with Cherry Green keyswitches + PBT DS keycaps
Software Gentoo Linux x64 / Windows 11 Enterprise IoT 2024
Such move is probably illegal anyway. There is even a precedent in US law, when IBM's hdds got reverse engineered in 196x.
Why reference such an ancient case when we have Oracle v Google and it decided that yes, these things are legal, at the level of the Supreme Court no less?

No I don't agree with it either but it seems to be law right now.

Even Transmeta was allowed to release processors that ran x86 code. Wine is a better example, and while Microsoft hampered it, they never sued anyone. When you are exceeding peak Microsoft levels of asshattery, you have to stop and think if what you're doing is right in the long run.
All those are really in a legal grey area since Oracle v Google. Wine basically exists because Microsoft doesn't want the bad PR of suing it. Transmeta was made before the Oracle v Google case so they didn't know what hot water it was getting into.
 
Joined
Nov 26, 2021
Messages
1,642 (1.51/day)
Location
Mississauga, Canada
Processor Ryzen 7 5700X
Motherboard ASUS TUF Gaming X570-PRO (WiFi 6)
Cooling Noctua NH-C14S (two fans)
Memory 2x16GB DDR4 3200
Video Card(s) Reference Vega 64
Storage Intel 665p 1TB, WD Black SN850X 2TB, Crucial MX300 1TB SATA, Samsung 830 256 GB SATA
Display(s) Nixeus NX-EDG27, and Samsung S23A700
Case Fractal Design R5
Power Supply Seasonic PRIME TITANIUM 850W
Mouse Logitech
VR HMD Oculus Rift
Software Windows 11 Pro, and Ubuntu 20.04
Why reference such an ancient case when we have Oracle v Google and it decided that yes, these things are legal, at the level of the Supreme Court no less?

No I don't agree with it either but it seems to be law right now.


All those are really in a legal grey area since Oracle v Google. Wine basically exists because Microsoft doesn't want the bad PR of suing it. Transmeta was made before the Oracle v Google case so they didn't know what hot water it was getting into.
Didn't Oracle vs Google find in Google's favour, but sidestep the issue of copyrighting APIs?
 
Joined
Aug 20, 2007
Messages
21,443 (3.40/day)
System Name Pioneer
Processor Ryzen R9 9950X
Motherboard GIGABYTE Aorus Elite X670 AX
Cooling Noctua NH-D15 + A whole lotta Sunon and Corsair Maglev blower fans...
Memory 64GB (4x 16GB) G.Skill Flare X5 @ DDR5-6000 CL30
Video Card(s) XFX RX 7900 XTX Speedster Merc 310
Storage Intel 905p Optane 960GB boot, +2x Crucial P5 Plus 2TB PCIe 4.0 NVMe SSDs
Display(s) 55" LG 55" B9 OLED 4K Display
Case Thermaltake Core X31
Audio Device(s) TOSLINK->Schiit Modi MB->Asgard 2 DAC Amp->AKG Pro K712 Headphones or HDMI->B9 OLED
Power Supply FSP Hydro Ti Pro 850W
Mouse Logitech G305 Lightspeed Wireless
Keyboard WASD Code v3 with Cherry Green keyswitches + PBT DS keycaps
Software Gentoo Linux x64 / Windows 11 Enterprise IoT 2024
Didn't Oracle vs Google find in Google's favour, but sidestep the issue of copyrighting APIs?
Reading the detailed wiki article, it seems you are right. They basically allow it in a very narrow "fair use" context.
 
Last edited:
Joined
May 3, 2018
Messages
2,881 (1.20/day)
Didn't Oracle vs Google find in Google's favour, but sidestep the issue of copyrighting APIs?
I'd like Nvidia to prove to the Supreme Court using CUDA on other hardware is not fair use. Google won the case 6-2 so Nvidia would have a hell of time getting them to overturn their own decision.

Nvidia can write what they want, but they have no legal standing. No one is reverse engineering their API.

Google vs Oracle
 
Joined
Jun 18, 2021
Messages
2,547 (2.04/day)
They basically allow it in a very narrow "fair use" context

Not really that narrow, the four pillars of fair use have been well described, there's loads of room for interpretation but clear guidelines exist for what can constitute fair use.

I'd like Nvidia to prove to the Supreme Court using CUDA on other hardware is not fair use. Google won the case 6-2 so Nvidia would have a hell of time getting them to overturn their own decision.

Nvidia can write what they want, but they have no legal standing. No one is reverse engineering their API.

Google vs Oracle

A saving grace for google was how little of java api's they've used and how many different things they did with it. A cuda wrapper would need to cover almost everything and try to do as close to the same as cuda as possible so the case would lead to different discussions
 
Joined
Jan 3, 2021
Messages
3,478 (2.45/day)
Location
Slovenia
Processor i5-6600K
Motherboard Asus Z170A
Cooling some cheap Cooler Master Hyper 103 or similar
Memory 16GB DDR4-2400
Video Card(s) IGP
Storage Samsung 850 EVO 250GB
Display(s) 2x Oldell 24" 1920x1200
Case Bitfenix Nova white windowless non-mesh
Audio Device(s) E-mu 1212m PCI
Power Supply Seasonic G-360
Mouse Logitech Marble trackball, never had a mouse
Keyboard Key Tronic KT2000, no Win key because 1994
Software Oldwin
CUDA, Wine, Java, x86 - we have mentioned several [legal] cases that have little in common between them to make any predictions on this latest one. The case of x86 is probably the most similar.

What exactly is Nvidia trying to protect here? Not the ISA - it remains secure by being obscure enough, as of now. Not the CUDA API - at least Tom's Hardware notes that "Recompiling existing CUDA programs remains perfectly legal. To simplify this, both AMD and Intel have tools to port CUDA programs to their ROCm and OpenAPI platforms, respectively."

So they are legally protecting their compiled binaries, or rather the IP contained within. The big precious bunch of optimisations and whatever else. And how much does this matter? Full compilation is necessary anyway if one wants the best performance, and we don't buy accelerators for mediocre performance, right?
 
Joined
Sep 6, 2013
Messages
3,328 (0.81/day)
Location
Athens, Greece
System Name 3 desktop systems: Gaming / Internet / HTPC
Processor Ryzen 5 5500 / Ryzen 5 4600G / FX 6300 (12 years latter got to see how bad Bulldozer is)
Motherboard MSI X470 Gaming Plus Max (1) / MSI X470 Gaming Plus Max (2) / Gigabyte GA-990XA-UD3
Cooling Νoctua U12S / Segotep T4 / Snowman M-T6
Memory 32GB - 16GB G.Skill RIPJAWS 3600+16GB G.Skill Aegis 3200 / 16GB JUHOR / 16GB Kingston 2400MHz (DDR3)
Video Card(s) ASRock RX 6600 + GT 710 (PhysX)/ Vega 7 integrated / Radeon RX 580
Storage NVMes, ONLY NVMes/ NVMes, SATA Storage / NVMe boot(Clover), SATA storage
Display(s) Philips 43PUS8857/12 UHD TV (120Hz, HDR, FreeSync Premium) ---- 19'' HP monitor + BlitzWolf BW-V5
Case Sharkoon Rebel 12 / CoolerMaster Elite 361 / Xigmatek Midguard
Audio Device(s) onboard
Power Supply Chieftec 850W / Silver Power 400W / Sharkoon 650W
Mouse CoolerMaster Devastator III Plus / CoolerMaster Devastator / Logitech
Keyboard CoolerMaster Devastator III Plus / CoolerMaster Devastator / Logitech
Software Windows 10 / Windows 10&Windows 11 / Windows 10
Nvidia can write what they want, but they have no legal standing.
Do they care if they can have any legal standing?
For example. Let's say that I go to my neighbor and I say "Look, we are good neighbors but if you keep watering your garden at 10 pm I will call the police and sue you". Even if my neighbor knows that the police will do nothing and I have no legal base in what I say, he still might stop or consider stopping watering his garden at 10 pm just to avoid ending up with a hostile neighbor. And in my opinion, this is what Nvidia tries to do. Scare people.
 
Joined
Feb 26, 2024
Messages
87 (0.32/day)
Why stupid? I remember well when/how it started - it was Cg or C for graphics on GeForce3 and much time and effort went into producing the tool CUDA is today, so no wonder nvidia defends it. AMD and intel surely didn't chip in for development... Make sense.
Yeah, started out with researchers using shader engines for more general compute. CUDA debut was 2007 and the GF 8800 series really started to get the ball rolling with better compute capabilities. I think it would be a case of irresponsible fiduciary execution if the company didn't protect their investors by maximizing profits. Nvidia could be sued for that. So, they are not really being mean, or even greedy - they are acting in the best interests of it's investors and their employees.
 
Joined
Jan 3, 2021
Messages
3,478 (2.45/day)
Location
Slovenia
Processor i5-6600K
Motherboard Asus Z170A
Cooling some cheap Cooler Master Hyper 103 or similar
Memory 16GB DDR4-2400
Video Card(s) IGP
Storage Samsung 850 EVO 250GB
Display(s) 2x Oldell 24" 1920x1200
Case Bitfenix Nova white windowless non-mesh
Audio Device(s) E-mu 1212m PCI
Power Supply Seasonic G-360
Mouse Logitech Marble trackball, never had a mouse
Keyboard Key Tronic KT2000, no Win key because 1994
Software Oldwin
So I went looking up Wiktionary to maybe find zluda in Croatian/Serbian, and found this in Polish instead. That guy knew how to pick a name so closely related to AI.

1709849333230.png
 
Top