• Welcome to TechPowerUp Forums, Guest! Please check out our forum guidelines for info related to our community.

AMD's 2019 "Gaming Super Resolution" Patent Could be the Blueprint for FidelityFX Super Resolution?

btarunr

Editor & Senior Moderator
Staff member
Joined
Oct 9, 2007
Messages
47,249 (7.54/day)
Location
Hyderabad, India
System Name RBMK-1000
Processor AMD Ryzen 7 5700G
Motherboard ASUS ROG Strix B450-E Gaming
Cooling DeepCool Gammax L240 V2
Memory 2x 8GB G.Skill Sniper X
Video Card(s) Palit GeForce RTX 2080 SUPER GameRock
Storage Western Digital Black NVMe 512GB
Display(s) BenQ 1440p 60 Hz 27-inch
Case Corsair Carbide 100R
Audio Device(s) ASUS SupremeFX S1220A
Power Supply Cooler Master MWE Gold 650W
Mouse ASUS ROG Strix Impact
Keyboard Gamdias Hermes E2
Software Windows 11 Pro
As AMD's upcoming feature that rivals NVIDIA DLSS nears release, reportedly this June, a USPTO patent application sheds some light on its inner workings. In its November 2019 application, AMD describes the feature as "Gaming Super Resolution." The abstract points to what the feature essentially does—downscaling or upscaling images using various methods, with the goal of improving performance, without much loss in fidelity. "The present application provides devices and methods for efficiently super-resolving an image, which preserves the original information of the image while upscaling the image and improving fidelity. The devices and methods utilize linear and non-linear up-sampling in a wholly learned environment," the application reads.

The application emphasizes on using a combination of linear and non-linear upscaling methods to improve the fidelity of the lower-resolution render output to the user's display resolution, including leveraging a "wholly learned" AI deep-learning network. This would be a DNN that relies on ground-truth information to reconstruct some fidelity to the upscaled image. "The devices and methods include a gaming super resolution (GSR) network architecture which efficiently super resolves images in a convolutional and generalizable manner."



"The GSR architecture employs image condensation and a combination of linear and nonlinear operations to accelerate the process to gaming viable levels. GSR renders images at a low quality scale to create high quality image approximations and achieve high framerates. High quality reference images are approximated by applying a specific configuration of convolutional layers and activation functions to a low quality reference image. The GSR network approximates more generalized problems more accurately and efficiently than conventional super resolution techniques by training the weights of the convolutional layers with a corpus of images."

A lot of water has flown under the bridge since November 2019. DLSS 2.0, introduced in March 2020, was a runaway success as a feature. It doesn't rely on wholly-learned DNNs, and uses temporal feedback techniques to reconstruct details in the final image. The FidelityFX Super Sampling feature that does come out next month, could hence be vastly different, as AMD is taking its own sweet time testing and validating the technology with game developers.

View at TechPowerUp Main Site
 

W1zzard

Administrator
Staff member
Joined
May 14, 2004
Messages
27,857 (3.71/day)
Processor Ryzen 7 5700X
Memory 48 GB
Video Card(s) RTX 4080
Storage 2x HDD RAID 1, 3x M.2 NVMe
Display(s) 30" 2560x1600 + 19" 1280x1024
Software Windows 10 64-bit
Awesome patent... "device to upscale and downscale images"
 
Joined
Nov 6, 2016
Messages
1,752 (0.59/day)
Location
NH, USA
System Name Lightbringer
Processor Ryzen 7 2700X
Motherboard Asus ROG Strix X470-F Gaming
Cooling Enermax Liqmax Iii 360mm AIO
Memory G.Skill Trident Z RGB 32GB (8GBx4) 3200Mhz CL 14
Video Card(s) Sapphire RX 5700XT Nitro+
Storage Hp EX950 2TB NVMe M.2, HP EX950 1TB NVMe M.2, Samsung 860 EVO 2TB
Display(s) LG 34BK95U-W 34" 5120 x 2160
Case Lian Li PC-O11 Dynamic (White)
Power Supply BeQuiet Straight Power 11 850w Gold Rated PSU
Mouse Glorious Model O (Matte White)
Keyboard Royal Kludge RK71
Software Windows 10
Awesome patent... "device to upscale and downscale images"
Having written a patent, two actually, my understanding is that they're supposed to geared toward a more general audience, and the wider the scope your parent encompasses the better as you can essentially lock up more "territory" that way...basically, they're not supposed to be a white paper. I could be wrong though as both my patents were not in the software or semiconductor category, but a type of table base (for a furniture company I was running at the time) and a manufacturing process for a business I hope to start soon.... Again, I could be wrong as I don't have experience in software
 

las

Joined
Nov 14, 2012
Messages
1,693 (0.38/day)
System Name Meh
Processor 7800X3D
Motherboard MSI X670E Tomahawk
Cooling Thermalright Phantom Spirit
Memory 32GB G.Skill @ 6000/CL30
Video Card(s) Gainward RTX 4090 Phantom / Undervolt + OC
Storage Samsung 990 Pro 2TB + WD SN850X 1TB + 64TB NAS/Server
Display(s) 27" 1440p IPS @ 360 Hz + 32" 4K/UHD QD-OLED @ 240 Hz + 77" 4K/UHD QD-OLED @ 144 Hz VRR
Case Fractal Design North XL
Audio Device(s) FiiO DAC
Power Supply Corsair RM1000x / Native 12VHPWR
Mouse Logitech G Pro Wireless Superlight + Razer Deathadder V3 Pro
Keyboard Corsair K60 Pro / MX Low Profile Speed
Software Windows 10 Pro x64
Can't wait to see it being compared to DLSS. AMD needs this feature badly, especially because their RT performance is lacking to begin with, but their 4K and 5K performance is also lacking even without RT and this is where DLSS truly shines; high res gaming.

I will be truly amazed if AMD manages to deliver what DLSS does, or even close, in both performance and visuals. DLSS 1.0 sucked but 2.x is great, if the implementation is good that is.

If XSX, XSS and PS5 will support this, maybe PC games will adopt it "faster"
 
Last edited:

W1zzard

Administrator
Staff member
Joined
May 14, 2004
Messages
27,857 (3.71/day)
Processor Ryzen 7 5700X
Memory 48 GB
Video Card(s) RTX 4080
Storage 2x HDD RAID 1, 3x M.2 NVMe
Display(s) 30" 2560x1600 + 19" 1280x1024
Software Windows 10 64-bit
they're supposed to geared toward a more general audience, and the wider the scope your parent encompasses the better as you can essentially lock up more "territory" that way
You are absolutely correct. Seems to me they filed for exactly that reason, without any actual invention behind it, probably just trying to game the broken system
 
Joined
Jul 16, 2014
Messages
8,200 (2.16/day)
Location
SE Michigan
System Name Dumbass
Processor AMD Ryzen 7800X3D
Motherboard ASUS TUF gaming B650
Cooling Artic Liquid Freezer 2 - 420mm
Memory G.Skill Sniper 32gb DDR5 6000
Video Card(s) GreenTeam 4070 ti super 16gb
Storage Samsung EVO 500gb & 1Tb, 2tb HDD, 500gb WD Black
Display(s) 1x Nixeus NX_EDG27, 2x Dell S2440L (16:9)
Case Phanteks Enthoo Primo w/8 140mm SP Fans
Audio Device(s) onboard (realtek?) - SPKRS:Logitech Z623 200w 2.1
Power Supply Corsair HX1000i
Mouse Steeseries Esports Wireless
Keyboard Corsair K100
Software windows 10 H
Benchmark Scores https://i.imgur.com/aoz3vWY.jpg?2
as AMD is taking its own sweet time testing and validating the technology with game developers.
@btarunr
You almost sound sarcastic, but I could be mistaken. :D
 

bug

Joined
May 22, 2015
Messages
13,792 (3.96/day)
Processor Intel i5-12600k
Motherboard Asus H670 TUF
Cooling Arctic Freezer 34
Memory 2x16GB DDR4 3600 G.Skill Ripjaws V
Video Card(s) EVGA GTX 1060 SC
Storage 500GB Samsung 970 EVO, 500GB Samsung 850 EVO, 1TB Crucial MX300 and 2TB Crucial MX500
Display(s) Dell U3219Q + HP ZR24w
Case Raijintek Thetis
Audio Device(s) Audioquest Dragonfly Red :D
Power Supply Seasonic 620W M12
Mouse Logitech G502 Proteus Core
Keyboard G.Skill KM780R
Software Arch Linux + Win10
Joined
May 31, 2016
Messages
4,437 (1.43/day)
Location
Currently Norway
System Name Bro2
Processor Ryzen 5800X
Motherboard Gigabyte X570 Aorus Elite
Cooling Corsair h115i pro rgb
Memory 32GB G.Skill Flare X 3200 CL14 @3800Mhz CL16
Video Card(s) Powercolor 6900 XT Red Devil 1.1v@2400Mhz
Storage M.2 Samsung 970 Evo Plus 500MB/ Samsung 860 Evo 1TB
Display(s) LG 27UD69 UHD / LG 27GN950
Case Fractal Design G
Audio Device(s) Realtec 5.1
Power Supply Seasonic 750W GOLD
Mouse Logitech G402
Keyboard Logitech slim
Software Windows 10 64 bit
I will patent 90° angle! :D
I'd go with 180 since this one is in-line :p
If XSX, XSS and PS5 will support this, maybe PC games will adopt it "faster"
PC support is supposedly be the first one to receive it and the consoles will follow later on. At least that's the word.
 

las

Joined
Nov 14, 2012
Messages
1,693 (0.38/day)
System Name Meh
Processor 7800X3D
Motherboard MSI X670E Tomahawk
Cooling Thermalright Phantom Spirit
Memory 32GB G.Skill @ 6000/CL30
Video Card(s) Gainward RTX 4090 Phantom / Undervolt + OC
Storage Samsung 990 Pro 2TB + WD SN850X 1TB + 64TB NAS/Server
Display(s) 27" 1440p IPS @ 360 Hz + 32" 4K/UHD QD-OLED @ 240 Hz + 77" 4K/UHD QD-OLED @ 144 Hz VRR
Case Fractal Design North XL
Audio Device(s) FiiO DAC
Power Supply Corsair RM1000x / Native 12VHPWR
Mouse Logitech G Pro Wireless Superlight + Razer Deathadder V3 Pro
Keyboard Corsair K60 Pro / MX Low Profile Speed
Software Windows 10 Pro x64
I'd go with 180 since this one is in-line :p

PC support is supposedly be the first one to receive it and the consoles will follow later on. At least that's the word.

I would just think if consoles have gotten it first then developers would be more likely to implement it in the pc version, but im not sure.

I also "read" that PS5 is not fully capable of using "FSR" because it's not full RDNA2, again, not sure.

AMD did not state much about the tech so we are still guessing, and it's supposed to release next month?
 
Joined
May 31, 2016
Messages
4,437 (1.43/day)
Location
Currently Norway
System Name Bro2
Processor Ryzen 5800X
Motherboard Gigabyte X570 Aorus Elite
Cooling Corsair h115i pro rgb
Memory 32GB G.Skill Flare X 3200 CL14 @3800Mhz CL16
Video Card(s) Powercolor 6900 XT Red Devil 1.1v@2400Mhz
Storage M.2 Samsung 970 Evo Plus 500MB/ Samsung 860 Evo 1TB
Display(s) LG 27UD69 UHD / LG 27GN950
Case Fractal Design G
Audio Device(s) Realtec 5.1
Power Supply Seasonic 750W GOLD
Mouse Logitech G402
Keyboard Logitech slim
Software Windows 10 64 bit
I would just think if consoles have gotten it first then developers would be more likely to implement it in the pc version, but im not sure.

I also "read" that PS5 is not fully capable of using "FSR" because it's not full RDNA2, again, not sure.

AMD did not state much about the tech so we are still guessing, and it's supposed to release next month?
Wouldn't it be also if PC's are getting it first then developers will be more likely to implement it in the consoles since these are basically same as PC nowadays?
And most important, the showcase for the FSR would be much more profound on a PC wouldn't you say?

Here's the video cardz link
There's a video also if you're interested.
 

las

Joined
Nov 14, 2012
Messages
1,693 (0.38/day)
System Name Meh
Processor 7800X3D
Motherboard MSI X670E Tomahawk
Cooling Thermalright Phantom Spirit
Memory 32GB G.Skill @ 6000/CL30
Video Card(s) Gainward RTX 4090 Phantom / Undervolt + OC
Storage Samsung 990 Pro 2TB + WD SN850X 1TB + 64TB NAS/Server
Display(s) 27" 1440p IPS @ 360 Hz + 32" 4K/UHD QD-OLED @ 240 Hz + 77" 4K/UHD QD-OLED @ 144 Hz VRR
Case Fractal Design North XL
Audio Device(s) FiiO DAC
Power Supply Corsair RM1000x / Native 12VHPWR
Mouse Logitech G Pro Wireless Superlight + Razer Deathadder V3 Pro
Keyboard Corsair K60 Pro / MX Low Profile Speed
Software Windows 10 Pro x64
Wouldn't it be also if PC's are getting it first then developers will be more likely to implement it in the consoles since these are basically same as PC nowadays?
And most important, the showcase for the FSR would be much more profound on a PC wouldn't you say?

Here's the video cardz link
There's a video also if you're interested.

I have already seen that video

It's much easier for dev's to implement specific features on console, but if PS5 does not fully support FSR it's going to be a problem
 
Joined
May 31, 2016
Messages
4,437 (1.43/day)
Location
Currently Norway
System Name Bro2
Processor Ryzen 5800X
Motherboard Gigabyte X570 Aorus Elite
Cooling Corsair h115i pro rgb
Memory 32GB G.Skill Flare X 3200 CL14 @3800Mhz CL16
Video Card(s) Powercolor 6900 XT Red Devil 1.1v@2400Mhz
Storage M.2 Samsung 970 Evo Plus 500MB/ Samsung 860 Evo 1TB
Display(s) LG 27UD69 UHD / LG 27GN950
Case Fractal Design G
Audio Device(s) Realtec 5.1
Power Supply Seasonic 750W GOLD
Mouse Logitech G402
Keyboard Logitech slim
Software Windows 10 64 bit
I have already seen that video

It's much easier for dev's to implement specific features on console, but if PS5 does not fully support FSR it's going to be a problem
It is supposed to be easier for all devs not just the console ones. Either way it is coming and I'm looking forward to seeing what it can do.
 

bug

Joined
May 22, 2015
Messages
13,792 (3.96/day)
Processor Intel i5-12600k
Motherboard Asus H670 TUF
Cooling Arctic Freezer 34
Memory 2x16GB DDR4 3600 G.Skill Ripjaws V
Video Card(s) EVGA GTX 1060 SC
Storage 500GB Samsung 970 EVO, 500GB Samsung 850 EVO, 1TB Crucial MX300 and 2TB Crucial MX500
Display(s) Dell U3219Q + HP ZR24w
Case Raijintek Thetis
Audio Device(s) Audioquest Dragonfly Red :D
Power Supply Seasonic 620W M12
Mouse Logitech G502 Proteus Core
Keyboard G.Skill KM780R
Software Arch Linux + Win10
I would just think if consoles have gotten it first then developers would be more likely to implement it in the pc version, but im not sure.

I also "read" that PS5 is not fully capable of using "FSR" because it's not full RDNA2, again, not sure.

AMD did not state much about the tech so we are still guessing, and it's supposed to release next month?
I think it all comes down to how much you can figure out initially. I mean, I'm sure Nvidia didn't plan for DLSS 1.0 as we got it, but it was all they could pull off at the time. That improved dramatically later on. It's possible AMD is in a similar position: aiming for the Moon, but having to settle initially. Another guess: PC first, because PC actually uses more resolutions. If you start with consoles and their two resolutions, you may miss cases that are hard to fix later on. Again, just a guess.
 
Joined
Apr 18, 2013
Messages
1,260 (0.30/day)
Location
Artem S. Tashkinov
If this is it, I don't have any confidence in this tech.

You cannot upscale anything and everything just by using simple math algorithms, DLSS is a lot more than that.

If it had been that simple, we'd have had re(shaders) by now which can do what DLSS 2.0 does and work on all GPUs.
 
Joined
Jul 3, 2019
Messages
322 (0.16/day)
Location
Bulgaria
Processor 6700K
Motherboard M8G
Cooling D15S
Memory 16GB 3k15
Video Card(s) 2070S
Storage 850 Pro
Display(s) U2410
Case Core X2
Audio Device(s) ALC1150
Power Supply Seasonic
Mouse Razer
Keyboard Logitech
Software 22H2
We have no idea what tech will be behind FSR, this is just a patent for which the 18 months expired.
 
Joined
Aug 20, 2007
Messages
21,483 (3.40/day)
System Name Pioneer
Processor Ryzen R9 9950X
Motherboard GIGABYTE Aorus Elite X670 AX
Cooling Noctua NH-D15 + A whole lotta Sunon and Corsair Maglev blower fans...
Memory 64GB (4x 16GB) G.Skill Flare X5 @ DDR5-6000 CL30
Video Card(s) XFX RX 7900 XTX Speedster Merc 310
Storage Intel 905p Optane 960GB boot, +2x Crucial P5 Plus 2TB PCIe 4.0 NVMe SSDs
Display(s) 55" LG 55" B9 OLED 4K Display
Case Thermaltake Core X31
Audio Device(s) TOSLINK->Schiit Modi MB->Asgard 2 DAC Amp->AKG Pro K712 Headphones or HDMI->B9 OLED
Power Supply FSP Hydro Ti Pro 850W
Mouse Logitech G305 Lightspeed Wireless
Keyboard WASD Code v3 with Cherry Green keyswitches + PBT DS keycaps
Software Gentoo Linux x64 / Windows 11 Enterprise IoT 2024

bug

Joined
May 22, 2015
Messages
13,792 (3.96/day)
Processor Intel i5-12600k
Motherboard Asus H670 TUF
Cooling Arctic Freezer 34
Memory 2x16GB DDR4 3600 G.Skill Ripjaws V
Video Card(s) EVGA GTX 1060 SC
Storage 500GB Samsung 970 EVO, 500GB Samsung 850 EVO, 1TB Crucial MX300 and 2TB Crucial MX500
Display(s) Dell U3219Q + HP ZR24w
Case Raijintek Thetis
Audio Device(s) Audioquest Dragonfly Red :D
Power Supply Seasonic 620W M12
Mouse Logitech G502 Proteus Core
Keyboard G.Skill KM780R
Software Arch Linux + Win10
If this is it, I don't have any confidence in this tech.

You cannot upscale anything and everything just by using simple math algorithms, DLSS is a lot more than that.

If it had been that simple, we'd have had re(shaders) by now which can do what DLSS 2.0 does and work on all GPUs.
The application emphasizes on using a combination of linear and non-linear upscaling methods to improve the fidelity of the lower-resolution render output to the user's display resolution, including leveraging a "wholly learned" AI deep-learning network.
;)
 
D

Deleted member 190774

Guest
If this is it, I don't have any confidence in this tech.

You cannot upscale anything and everything just by using simple math algorithms, DLSS is a lot more than that.

If it had been that simple, we'd have had re(shaders) by now which can do what DLSS 2.0 does and work on all GPUs.
And what are your credentials? Can you demonstrate some of these simple math algorithms?

I suspect it is not simple math.
 

las

Joined
Nov 14, 2012
Messages
1,693 (0.38/day)
System Name Meh
Processor 7800X3D
Motherboard MSI X670E Tomahawk
Cooling Thermalright Phantom Spirit
Memory 32GB G.Skill @ 6000/CL30
Video Card(s) Gainward RTX 4090 Phantom / Undervolt + OC
Storage Samsung 990 Pro 2TB + WD SN850X 1TB + 64TB NAS/Server
Display(s) 27" 1440p IPS @ 360 Hz + 32" 4K/UHD QD-OLED @ 240 Hz + 77" 4K/UHD QD-OLED @ 144 Hz VRR
Case Fractal Design North XL
Audio Device(s) FiiO DAC
Power Supply Corsair RM1000x / Native 12VHPWR
Mouse Logitech G Pro Wireless Superlight + Razer Deathadder V3 Pro
Keyboard Corsair K60 Pro / MX Low Profile Speed
Software Windows 10 Pro x64
I think it all comes down to how much you can figure out initially. I mean, I'm sure Nvidia didn't plan for DLSS 1.0 as we got it, but it was all they could pull off at the time. That improved dramatically later on. It's possible AMD is in a similar position: aiming for the Moon, but having to settle initially. Another guess: PC first, because PC actually uses more resolutions. If you start with consoles and their two resolutions, you may miss cases that are hard to fix later on. Again, just a guess.

Yeah and Sony already patented some upscaling tech.
 
Joined
Apr 30, 2011
Messages
2,705 (0.54/day)
Location
Greece
Processor AMD Ryzen 5 5600@80W
Motherboard MSI B550 Tomahawk
Cooling ZALMAN CNPS9X OPTIMA
Memory 2*8GB PATRIOT PVS416G400C9K@3733MT_C16
Video Card(s) Sapphire Radeon RX 6750 XT Pulse 12GB
Storage Sandisk SSD 128GB, Kingston A2000 NVMe 1TB, Samsung F1 1TB, WD Black 10TB
Display(s) AOC 27G2U/BK IPS 144Hz
Case SHARKOON M25-W 7.1 BLACK
Audio Device(s) Realtek 7.1 onboard
Power Supply Seasonic Core GC 500W
Mouse Sharkoon SHARK Force Black
Keyboard Trust GXT280
Software Win 7 Ultimate 64bit/Win 10 pro 64bit/Manjaro Linux
Many rush into making comments without any knowledge on the topic. A very common issue for the human race. Patience is a big virtue though.
 
Top