NVIDIA GeForce RTX 50 Technical Deep Dive

[Waldorf]

But most people do prefer upscaling?

while the total amount is larger, we still dont know the "why".
e.g. how many use it, because they lack the (raw) power to do native.

 

[JustBenching]

while the total amount is larger, we still dont know the "why".
e.g. how many use it, because they lack the (raw) power to do native.

Does the why matter? In what sense?

I can tell you why I'm using it, because at 4k dlss q it performs as well as 1440p native but looks way better. So I'm using it for the increased image quality at same performance.

 

[Waldorf]

yes it does. because if i can do native without, i would.
meaning im not using it because i "want" to, and many others might too.

its like saying would you want to buy a +300K Bentley? most will probably say no.
but what if all those "asked", would have 1M in their account (to spend on a car)?
you think they would still (all) say no?

part of my problem with the poll, as i do use it (so not native), but would prefer (to be able) to use native.
and i doubt im alone, thus changing numbers by quite a bit.

 

[remekra]

yes it does. because if i can do native without, i would.
meaning im not using it because i "want" to, and many others might too.

its like saying would you want to buy a +300K Bentley? most will probably say no.
but what if all those "asked", would have 1M in their account (to spend on a car)?
you think they would still (all) say no?

part of my problem with the poll, as i do use it (so not native), but would prefer (to be able) to use native.
and i doubt im alone, thus changing numbers by quite a bit.

Some TAA if not most TAA implementations are so bad that what does it even mean that you are running native? It's still gathering data from multiple frames, it can still have ghosting and artifacts.
And I can't remember a game where there was no TAA recently.

 

[Waldorf]

for me native means native res the moni has, not AA related.

and at least for the games i have (nothing last 2y), i can select to not use TAA.

 

[JustBenching]

yes it does. because if i can do native without, i would.
meaning im not using it because i "want" to, and many others might too.

its like saying would you want to buy a +300K Bentley? most will probably say no.
but what if all those "asked", would have 1M in their account (to spend on a car)?
you think they would still (all) say no?

part of my problem with the poll, as i do use it (so not native), but would prefer (to be able) to use native.
and i doubt im alone, thus changing numbers by quite a bit.

But that's the point, if everyone had 1m in their account they would buy a higher resolution monitor and then use DLSS on it. Because it looks better than native, which is my point. If you are building a PC and the card you are targeting is a 1440p card (let's say XX70 tier), it's better to get a 4k monitor to use with it use DLSS Q. Will look much better than native 1440p. Which is what I did. My option was 1440p native (so a 1440p monitor) or 4k DLSS Q (so a 4k monitor). Went with the latter.

Just a fast demonstration. The so called superior 4k native. Zoom on it and have a laugh

Spoiler

And DLSS

Spoiler

These are not zoomed. Got some extra spicy details for people that think native looks better...

 

[Waldorf]

upscaling a lower res to native (moni) res will never look better, any native UHD video (vs same content at 720p/1080p upscaled to 4K) will easily show that.
you can not make up stuff, that wasnt there to begin with, and why even if it looks good and close, it wont match the same quality at native res.

and running a lower (than native) res on a higher resolution moni (vs lower res on content and lower res moni) will always look better,
but that's because of the higher res on the screen, not because of upscaling.

if upscaling would look better (than native), movie companies wouldnt waste shooting in UHD (or higher).

 

[zigzag]

you can not make up stuff, that wasnt there to begin with

This used to be true, but it isn't anymore. Making stuff up is the whole point of generative AI. Some can generate a pictures from text.

Also, some of the resolution increase can be real. Temporal sampling techniques can supersample single pixel through multiple frames. Due to motion it's not always perfect and can produce artifacts, but when it works it combines multiple lower resolution frames into a higher resolution image.

 

[JustBenching]

This used to be true, but it isn't anymore. Making stuff up is the whole point of generative AI. Some can generate a pictures from text.

No no, you can't make up detail from nothing. Image restoration isn't a thing

Spoiler

 

[Waldorf]

@zigzag
while it might work with games, with "real" content like movies/videos it wont.

it will look almost as good, and usually good enough so ppl dont "throw up" watching it on their big screen tv, but it will not surpass the quality of native res.

lets say i have an image that consist of a single color with a single dot somewhere, i now remove the area with the dot, AI will never be able to come up with dot in a "restored" image.

 

[dyonoctis]

That's a weird thing to say. You are actually giving to much credit to nvidia, and ignoring that people outside the company are also asking themselves how emerging technologies could affect various aspect of the gaming industry:
(PDF) Artificial intelligence for video game visualization, advancements, benefits and challenges
Jensen wasn't involved in that research paper, I would argue that research at AMD, nvidia, Intel, microsft etc... is probably influenced on some level but what's happening in academics labs, i don't believe that they function as a bubble.

To further reinforce the point that Neural rendering isn't something that nvidia invented, nor ar they the only people researching it's application:
Intel's Latest Research for Graphics and Generative AI
Neural Prefiltering for Correlation-Aware Levels of Detail
UniTorch - Integrating Neural Rendering into Unity | Request PDF

 

[LittleBro]

@zigzag
while it might work with games, with "real" content like movies/videos it wont.

it will look almost as good, and usually good enough so ppl dont "throw up" watching it on their big screen tv, but it will not surpass the quality of native res.

lets say i have an image that consist of a single color with a single dot somewhere, i now remove the area with the dot, AI will never be able to come up with dot in a "restored" image.

Don't waste your time. Good point with your previous statement about how you cannot make up stuff out of nothing.

Does not matter that upscaled or so called "AI" generated content is something artificial or guessed. When it's shiny, it must be good, right?

Breasts upscaled by LSBT (Large Silicon Breast Tuning) algorithm in so called "beauty clinic" are still nothing else but a pair of fake tits.

 

[JustBenching]

Don't waste your time. Good point with your previous statement about how you cannot make up stuff out of nothing.

Does not matter that upscaled or so called "AI" generated content is something artificial or guessed. When it's shiny, it must be good, right?

Breasts upscaled by LSBT (Large Silicon Breast Tuning) algorithm in so called "beauty clinic" are still nothing else but a pair of fake tits.

So I assume the left looks better than the right to you?

Spoiler

 

[Sound_Card]

So I assume the left looks better than the right to you?

Spoiler

lol pure sophistry.

 

[zigzag]

@zigzag
while it might work with games, with "real" content like movies/videos it wont.

it will look almost as good, and usually good enough so ppl dont "throw up" watching it on their big screen tv, but it will not surpass the quality of native res.

lets say i have an image that consist of a single color with a single dot somewhere, i now remove the area with the dot, AI will never be able to come up with dot in a "restored" image.

Even a human can't do that. But if there is more context, like a nose missing on a face, some AI models would generate a new nose.

But that's not what we are dealing with here! Game renders a lower-res image, which is together with previous frames and motion vectors provided as a context for the model. If final resolution is 4k, you render lower-res image at ~1080p. That means that your dot would need to be smaller than one pixel at 1080p to be missing from input data. Do you realize how fine these details are?

Note that just native resolution is not enough for great image quality. At native res, you still see aliasing in motion and other artifacts. You need super-sampling. 8x the native resolution for real high quality. GPUs won't be capable of brute forcing all the needed calculations for decades.

It's not about the native resolution, but image quality you can get with the limited performance your GPU can provide in real time. I hope we agree that the highest image-quality (a GPU can render in real time) is the goal. And to do that we need to sacrifice some quality, where it's the least noticeable in order to gain quality where it matters. We used to sacrifice some resolution in order to have shaders. And then to have better shaders. Now to do basic path tracing to get real reflections, proper lighting and shadows. And now we can also fake some fine details in order to improve perceived image quality. It's not perfect, but most of the time is better that brute forcing lower quality graphics at higher resolutions. It is also partly subjective what is important and what is not.

 

[Waldorf]

@zigzag
sure but thats because it learned that from previous training.
e.g. if i have a pixelated (say ultra low res) license plate from a car, no AI will be able to make that readable.

my problem is with ppl claiming that upscaling (from a lower res) to native res, will look better than straight native, which isnt the case.


upscaling to above native res, then downscaling to native (screen) res, is a completely different thing, works, looks better, i use it, and i never said anything to the contrary.