Dear AMD, NVIDIA, INTEL and others, we need cheap (192-bit to 384-bit), high VRAM, consumer, GPUs to locally self-host/inference AI/LLMs

lexluthermiester · 2025-02-14T13:03:44+0000

Bomby569 said:
i think we're past that, unless you have a very high end card, there is no point in turning RT on

Nonsense. The resolution used plays a factor, but even a 2070 can still do a reasonable amount of RTRT at 1440p. Newer cards have no issues unless we're talking about 4k.

Bomby569 · 2025-02-14T13:05:56+0000

lexluthermiester said:
Nonsense. The resolution used plays a factor, but even a 2070 can still do a reasonable amount of RTRT at 1440p. Newer cards have no issues unless we're talking about 4k.

what's this than

Vayra86 · 2025-02-14T13:07:18+0000

lexluthermiester said:
Nonsense. The resolution used plays a factor, but even a 2070 can still do a reasonable amount of RTRT at 1440p. Newer cards have no issues unless we're talking about 4k.

A 2070.... yeah. Dream on. The end result of that is like you're back in 2009. 720p isn't really a current resolution anymore

lexluthermiester · 2025-02-14T13:12:58+0000

Bomby569 said:
what's this than

That is one game. Nice cherry pick. Of course you kinda just proved my point for me.

Vayra86 said:
A 2070.... yeah. Dream on.

Nope, in reality.

Vayra86 said:
The end result of that is like you're back in 2009. 720p isn't really a current resolution anymore

I've recently demonstrated a 2060Super(which is very close to a 2070 by the specs.) to a customer and RTRT was on in CyberPunk2077 at 1080p. At 1440p, some settings had to be turned down but the performance was still acceptable.

Bomby569 · 2025-02-14T13:13:40+0000

lexluthermiester said:
That is one game. Nice cherry pick. Of course you kinda just proved my point for me.

that's not one game, all "you must have RT games" will look like that. Indiana Jones who could use RT settings?

lexluthermiester · 2025-02-14T13:20:31+0000

Bomby569 said:
that's not one game, all "you must have RT games" will look like that.

Are you kidding? Do you think you're talking to a moron?

Bomby569 said:
Indiana Jones who could use RT settings?

Indiana Jones & The Great Circle runs fine on a 2060. Sure, you have to turn some settings down, but it runs at perfectly playable framerates. At 2070 can do better.. along with everything else that is newer/better.

Bomby569 · 2025-02-14T13:23:50+0000

lexluthermiester said:
Are you kidding? Do you think you're talking to a moron?

Indiana Jones & The Great Circle runs fine on a 2060. Sure, you have to turn some settings down, but it runs at perfectly playable framerates. At 2070 can do better..

we're talking about RT specifically, not sure what you are replying to.

i try not to judge people

lexluthermiester · 2025-02-14T13:52:51+0000

Bomby569 said:
i try not to judge people

Fair enough.

Bomby569 said:
we're talking about RT specifically, not sure what you are replying to.

Yuppers. Indiana Jone is an RTRT only game. It won't run unless you've got it on your card.

Rover4444 · 2025-02-14T16:09:34+0000

lexluthermiester said:
Yes and there are some of us that are trying to help them and everyone else parroting this idea that it is not going to happen. And it does NOT take a genius to figure that out.

Either spend the money for the professional compute cards or live with the reduced speed of the consumer cards. Those are the choices. There are no others.

That's ok, no worries.

What, you're the invisible hand of the free market now?

Give us cheap VRAM or we won't buy new cards. There's plenty of current and upcoming alternatives available right now if you actually bothered to look, from Apple M2s and Strix Halo to repurposed mining rigs and networked machines. I am NOT obligated to buy crumbs for the price of a cake and say "thank you" for the privilege of winning a GPU lottery.

Ask for more and you'll get more, simple as.

mechtech · 2025-02-14T16:25:34+0000

lexluthermiester said:
Fair enough.

Yuppers. Indiana Jone is an RTRT only game. It won't run unless you've got it on your card.

Interesting, I did not know this. Well another thing to look out for........see if RT is mandatory and see if it can be disabled.

lexluthermiester · 2025-02-14T16:28:15+0000

Rover4444 said:
What, you're the invisible hand of the free market now?

No. I'm someone with a ton experience and have been in this industry for 4 decades.

Rover4444 said:
Give us cheap VRAM or we won't buy new cards.

And the short answer is: Have fun with that. IF you want the high end spec, you PAY the high end price. This is a dynamic that has been true ALWAYS. It has never not been true.

Rover4444 said:
Ask for more, pay for more and you'll get more, simple as that.

Fixed that for you. Thus.

mechtech said:
Interesting, I did not know this. Well another thing to look out for........see if RT is mandatory and see if it can be disabled.

Yeah, there are a few games going that direction. Players will need a card with RTRT features to play them.

mechtech · 2025-02-14T16:32:05+0000

lexluthermiester said:
Yeah, there are a few games going that direction. Players with need a card with RTRT features to play them.

Well that's a turn off...............

lexluthermiester · 2025-02-14T17:14:54+0000

mechtech said:
Well that's a turn off...............

For some it is. I personally love the effect. I think it's the nature direction for games and tech to be going.

Vayra86 · 2025-02-14T18:40:04+0000

lexluthermiester said:
That is one game. Nice cherry pick. Of course you kinda just proved my point for me.

Nope, in reality.

I've recently demonstrated a 2060Super(which is very close to a 2070 by the specs.) to a customer and RTRT was on in CyberPunk2077 at 1080p. At 1440p, some settings had to be turned down but the performance was still acceptable.

Sure thing, and you'll still be using some DLSS blurfest upscaling method to get there at 1080p. So like I said, great, but it looks like you're gaming in 2009. I'm sure some nitwit said WOW AWESOME in your store, that's really indicative of nothing and you know this. If the bar can be dropped that low for you to like something, again, great for you, but I'll pass. Additionally, we both know the lower RT settings (almost everything below Psycho) barely changes a thing in the image but sure you can say you've got the RT option enabled. Even so, the performance hit is still a DLSS scenario more often than not on the class of cards in 2060-2070 range. Which means you're literally rendering at 720p or some order below 1080p.

I mean sure I played Cyberpunk on a GTX 1080 but I'm not going to sell the fairy tale its a great experience, because you had to use upscaling to get playable frames and even then it wasn't exactly, you know, beautiful to look at. So enabling RT and then having to scale down settings left and right to get that playable on 1080p with a lower render res to boot is... yeah. The 'mental asylum is that way-territory', if you ask me. But sure, its a great way to make your point I guess. You CAN indeed run RT on a 2070. I can run PT too on a 7900XT. Don't ask how it runs but hey... if I turn everything down to low...

Rover4444 said:
What, you're the invisible hand of the free market now?

Give us cheap VRAM or we won't buy new cards. There's plenty of current and upcoming alternatives available right now if you actually bothered to look, from Apple M2s and Strix Halo to repurposed mining rigs and networked machines. I am NOT obligated to buy crumbs for the price of a cake and say "thank you" for the privilege of winning a GPU lottery.

Ask for more and you'll get more, simple as.

Lol yeah like you ask for more and you get a 2,5k 5090 to replace your 1,5k 4090.

Is that the more you mean? Or is the more being asked in this topic a straight up joke? Because you already GOT more. You're still saying you want more, and now its a class of card nobody in their right mind would make. And its already been explained to you but... ok you won't buy new cards. You can get in line with the other half of the world that isn't, and it hasn't stopped Nvidia reaching a 3 trillion market cap anyway. You think companies are looking for your business. You are mistaken.

lexluthermiester · 2025-02-14T22:10:33+0000

Yeah, we're off topic and I'm not going to take this any further.

Rover4444 · 2025-02-14T23:21:55+0000

lexluthermiester said:
No. I'm someone with a ton experience and have been in this industry for 4 decades.

And the short answer is: Have fun with that. IF you want the high end spec, you PAY the high end price. This is a dynamic that has been true ALWAYS. It has never not been true.

Fixed that for you. Thus.

Okay? Do you want cards with cheap VRAM or not? Just say you're running defense for corporations so people can stay constrained with what models they can run.

I don't have to buy anything, so I won't. If I really wanted to though, I'd just get two 22GB 2080 Tis for $400 each.

Vayra86 said:
Lol yeah like you ask for more and you get a 2,5k 5090 to replace your 1,5k 4090.

Is that the more you mean? Or is the more being asked in this topic a straight up joke?

No, it's not the more I mean. I thought it was very obvious what I mean. Did you not read the subject?

My idea of more would be a 24GB 4070 for $700-$800 as a true 3090 replacement. There's been rumors of 24GB B580s and 32GB 9070XTs, so there is plenty of very obvious market demand. Even before the AI bubble production users have been crying out for more VRAM, and now it's gotten so bad that even gamers are taking notice. Things really don't have to be this way.

16GB cards are already possible at $330. 24GB at $500 and 32GB at $700 isn't crazy, especially if you're using a B580-tier core. People even bought the 4060 Ti 16GB after NVIDIA priced it $100 over the 8GB version.

Processor	Ryzen 5 5700x
Motherboard	B550 Elite
Cooling	Thermalright Perless Assassin 120 SE
Memory	32GB Fury Beast DDR4 3200Mhz
Video Card(s)	Gigabyte 3060 ti gaming oc pro
Storage	Samsung 970 Evo 1TB, WD SN850x 1TB, plus some random HDDs
Display(s)	LG 27gp850 1440p 165Hz 27''
Case	Lian Li Lancool II performance
Power Supply	MSI 750w
Mouse	G502

System Name	Tiny the White Yeti
Processor	7800X3D
Motherboard	MSI MAG Mortar b650m wifi
Cooling	CPU: Thermalright Peerless Assassin / Case: Phanteks T30-120 x3
Memory	32GB Corsair Vengeance 30CL6000
Video Card(s)	ASRock RX7900XT Phantom Gaming
Storage	Lexar NM790 4TB + Samsung 850 EVO 1TB + Samsung 980 1TB + Crucial BX100 250GB
Display(s)	Gigabyte G34QWC (3440x1440)
Case	Lian Li A3 mATX White
Audio Device(s)	Harman Kardon AVR137 + 2.1
Power Supply	EVGA Supernova G2 750W
Mouse	Steelseries Aerox 5
Keyboard	Lenovo Thinkpad Trackpoint II
VR HMD	HD 420 - Green Edition ;)
Software	W11 IoT Enterprise LTSC
Benchmark Scores	Over 9000

Processor	Ryzen 5 5700x
Motherboard	B550 Elite
Cooling	Thermalright Perless Assassin 120 SE
Memory	32GB Fury Beast DDR4 3200Mhz
Video Card(s)	Gigabyte 3060 ti gaming oc pro
Storage	Samsung 970 Evo 1TB, WD SN850x 1TB, plus some random HDDs
Display(s)	LG 27gp850 1440p 165Hz 27''
Case	Lian Li Lancool II performance
Power Supply	MSI 750w
Mouse	G502

Processor	Ryzen 5 5700x
Motherboard	B550 Elite
Cooling	Thermalright Perless Assassin 120 SE
Memory	32GB Fury Beast DDR4 3200Mhz
Video Card(s)	Gigabyte 3060 ti gaming oc pro
Storage	Samsung 970 Evo 1TB, WD SN850x 1TB, plus some random HDDs
Display(s)	LG 27gp850 1440p 165Hz 27''
Case	Lian Li Lancool II performance
Power Supply	MSI 750w
Mouse	G502

Processor	Ryzen 5700x
Motherboard	Gigabyte X570S Aero G R1.1 BiosF5g
Cooling	Noctua NH-C12P SE14 w/ NF-A15 HS-PWM Fan 1500rpm
Memory	Micron DDR4-3200 2x32GB D.S. D.R. (CT2K32G4DFD832A)
Video Card(s)	AMD RX 6800 - Asus Tuf
Storage	Kingston KC3000 1TB & 2TB & 4TB Corsair MP600 Pro LPX
Display(s)	LG 27UL550-W (27" 4k)
Case	Be Quiet Pure Base 600 (no window)
Audio Device(s)	Realtek ALC1220-VB
Power Supply	SuperFlower Leadex V Gold Pro 850W ATX Ver2.52
Mouse	Mionix Naos Pro
Keyboard	Corsair Strafe with browns
Software	W10 22H2 Pro x64