Anonymous edits have been disabled on the wiki. If you want to contribute please login or create an account.


Warning for game developers: PCGamingWiki staff members will only ever reach out to you using the official press@pcgamingwiki.com mail address.
Be aware of scammers claiming to be representatives or affiliates of PCGamingWiki who promise a PCGW page for a game key.

Difference between revisions of "Glossary:High-fidelity upscaling"

From PCGamingWiki, the wiki about fixing PC games
(Fixing refs being grouped together and using breaks to group them together, instead turning them into seperate refs as is the usual way of doing seemingly on PCGW)
m (minor consistency change)
Line 15: Line 15:
  
 
== Deep Learning Super Sampling (DLSS) ==
 
== Deep Learning Super Sampling (DLSS) ==
[[DLSS| Deep Learning Super Sampling]] is a set of image upscaling algorithms developed by [[Nvidia]] for real-time use in video games, using deep learning to upscale lower-resolution images to a higher resolution that is accelerated through specialized hardware only present in the NVIDIA's RTX series GPUs.<ref>{{Refurl|url=https://web.archive.org/web/20190216011955/https://www.nvidia.com/en-us/geforce/news/nvidia-dlss-your-questions-answered/|title=NVIDIA DLSS: Your Questions, Answered|date=2019-02-16}}</ref>
+
[[DLSS| Deep Learning Super Sampling]] is a set of image upscaling algorithms developed by [[Nvidia]] for real-time use in video games, using deep learning to upscale lower-resolution images to a higher resolution that is accelerated through specialized hardware only present in the NVIDIA's RTX series GPUs<ref>{{Refurl|url=https://web.archive.org/web/20190216011955/https://www.nvidia.com/en-us/geforce/news/nvidia-dlss-your-questions-answered/|title=NVIDIA DLSS: Your Questions, Answered|date=2019-02-16}}</ref>.
  
 
DLSS was first announced with the release of the Nvidia RTX 20 series in September 2018 and the first titles featuring it released between then and March 2019. Needing per-game training and only being featured in a handful of games with generally subpar results, made DLSS (1.0) at the time rather disappointing and not recommended. An improved version of DLSS, unofficially labeled as 1.9, was shipped with the game [[Control]] in August 2019, providing better image quality than 1.0, although still generally worse than a native image of the upscaled resolution.{{cn|date=2023-02-19|reason=This DLSS implementation was considerably improved against previous ones and TechSpot came to the conclusion that they would rather use DLSS than playing at the render resolution natively.}}
 
DLSS was first announced with the release of the Nvidia RTX 20 series in September 2018 and the first titles featuring it released between then and March 2019. Needing per-game training and only being featured in a handful of games with generally subpar results, made DLSS (1.0) at the time rather disappointing and not recommended. An improved version of DLSS, unofficially labeled as 1.9, was shipped with the game [[Control]] in August 2019, providing better image quality than 1.0, although still generally worse than a native image of the upscaled resolution.{{cn|date=2023-02-19|reason=This DLSS implementation was considerably improved against previous ones and TechSpot came to the conclusion that they would rather use DLSS than playing at the render resolution natively.}}
  
DLSS 2.0 was released in March 2020 providing much better picture quality, performance and adjustable quality options over previous versions, and since it didn't need per-game training it was implemented into many more games and is now generally recommended if you have a supported GPU.<ref>{{Refurl|url=https://web.archive.org/web/20200327085023/https://www.nvidia.com/en-us/geforce/news/nvidia-dlss-2-0-a-big-leap-in-ai-rendering/|title=NVIDIA DLSS 2.0: A Big Leap In AI Rendering|date=2020-03-27}}</ref>
+
DLSS 2.0 was released in March 2020 providing much better picture quality, performance and adjustable quality options over previous versions, and since it didn't need per-game training it was implemented into many more games and is now generally recommended if you have a supported GPU<ref>{{Refurl|url=https://web.archive.org/web/20200327085023/https://www.nvidia.com/en-us/geforce/news/nvidia-dlss-2-0-a-big-leap-in-ai-rendering/|title=NVIDIA DLSS 2.0: A Big Leap In AI Rendering|date=2020-03-27}}</ref>.
  
 
DLSS 2.1 was released in September 2020 providing support for VR {{note|although only a few games implemented it way after its release}}, and introduced the Ultra performance quality option, meant for 8K gaming with the RTX 3090.
 
DLSS 2.1 was released in September 2020 providing support for VR {{note|although only a few games implemented it way after its release}}, and introduced the Ultra performance quality option, meant for 8K gaming with the RTX 3090.
 
Later versions of DLSS wouldn't provide much benefits as compared to before, mostly meant to fix issues with ghosting on fast moving objects, and these versions can be used on older DLSS 2.0 implementations via replacing a single .DLL file.
 
Later versions of DLSS wouldn't provide much benefits as compared to before, mostly meant to fix issues with ghosting on fast moving objects, and these versions can be used on older DLSS 2.0 implementations via replacing a single .DLL file.
  
DLSS 3.0 was announced on September 20th in Nvidia's September GTC 2022 keynote keeping the same upscaling algorithm that DLSS 2.x.x utilises while adding two more features that being AI Frame Generation and integrating Nvidia Reflex. Frame Generation is touted to massively increase framerates as shown in a demo of [[Microsoft Flight Simulator (2020)]] running at over 100 FPS with DLSS 3.0 as opposed to 60 without, although Frame Generation has drawbacks like it being only possible on the 40 series Ada Lovelace GPUs because of a new optical flow accelerator and it increasing input latency significantly. Nvidia Reflex is being integrated into DLSS to lower to the increased latency given by Frame Generation, much in the same way it reduced latency when used normally. Both Frame Generation and Nvidia Reflex alongside the original Upscaling algorithm will have toggles allowing users to enable any of the features as they want. DLSS 3 rolled out into games and programs in October 2022, with [[Marvel's Spider-Man Remastered]] being one of the first games implementing it on 12 October, 2022.<ref>{{Refurl|url=https://www.nvidia.com/en-us/geforce/news/dlss3-ai-powered-neural-graphics-innovations/|title=NVIDIA DLSS 3: AI-Powered Performance Multiplier Boosts Frame Rates By Up To 4X|date=2022-09-25}}</ref><ref>{{Refurl|url=https://store.steampowered.com/news/app/1817070/view/3543795218882882295|title=Marvel's Spider-Man Remastered v1.1011.1.0 Patch Notes|date=2022-11-07}}</ref>
+
DLSS 3.0 was announced on September 20th in Nvidia's September GTC 2022 keynote keeping the same upscaling algorithm that DLSS 2.x.x utilises while adding two more features that being AI Frame Generation and integrating Nvidia Reflex. Frame Generation is touted to massively increase framerates as shown in a demo of [[Microsoft Flight Simulator (2020)]] running at over 100 FPS with DLSS 3.0 as opposed to 60 without, although Frame Generation has drawbacks like it being only possible on the 40 series Ada Lovelace GPUs because of a new optical flow accelerator and it increasing input latency significantly. Nvidia Reflex is being integrated into DLSS to lower to the increased latency given by Frame Generation, much in the same way it reduced latency when used normally. Both Frame Generation and Nvidia Reflex alongside the original Upscaling algorithm will have toggles allowing users to enable any of the features as they want. DLSS 3 rolled out into games and programs in October 2022, with [[Marvel's Spider-Man Remastered]] being one of the first games implementing it on 12 October, 2022<ref>{{Refurl|url=https://www.nvidia.com/en-us/geforce/news/dlss3-ai-powered-neural-graphics-innovations/|title=NVIDIA DLSS 3: AI-Powered Performance Multiplier Boosts Frame Rates By Up To 4X|date=2022-09-25}}</ref><ref>{{Refurl|url=https://store.steampowered.com/news/app/1817070/view/3543795218882882295|title=Marvel's Spider-Man Remastered v1.1011.1.0 Patch Notes|date=2022-11-07}}</ref>.
  
 
== FidelityFX Super Resolution (FSR) ==
 
== FidelityFX Super Resolution (FSR) ==
 
[[FidelityFX Super Resolution]] is a set of open-source image upscaling algorithms developed by [[AMD]] for real-time use in video games, using traditional hand-written algorithms to upscale lower-resolution images to a higher resolution. It does not involve the use of machine-learning, unlike DLSS and XeSS, and runs on traditional shading units, thus doesn't need specialized hardware to function and can work on different vendors of GPUs.
 
[[FidelityFX Super Resolution]] is a set of open-source image upscaling algorithms developed by [[AMD]] for real-time use in video games, using traditional hand-written algorithms to upscale lower-resolution images to a higher resolution. It does not involve the use of machine-learning, unlike DLSS and XeSS, and runs on traditional shading units, thus doesn't need specialized hardware to function and can work on different vendors of GPUs.
  
FSR 1.0 was released in June 2021 with a handful of games supporting it and, although being a spatial upscaler, it generally provided a decent image at higher resolutions and quality presets (like 4K Ultra Quality), but lower resolutions and quality presets usually give a subpar image (at 1080p, or using the performance quality preset) - do note though that FSR's standardized presets are not enforced, so some titles such as Dota 2 offer resolution sliders instead.<ref>{{Refurl|url=https://web.archive.org/web/20210624100837/https://www.phoronix.com/scan.php?page=news_item&px=Dota-2-FidelityFX-Super-Res|title=Valve's Dota 2 Adds AMD FidelityFX Super Resolution|date=2021-06-24}}</ref> The driver level implementation of FSR 1.0 is known as Radeon Super Resolution.
+
FSR 1.0 was released in June 2021 with a handful of games supporting it and, although being a spatial upscaler, it generally provided a decent image at higher resolutions and quality presets (like 4K Ultra Quality), but lower resolutions and quality presets usually give a subpar image (at 1080p, or using the performance quality preset) - do note though that FSR's standardized presets are not enforced, so some titles such as Dota 2 offer resolution sliders instead<ref>{{Refurl|url=https://web.archive.org/web/20210624100837/https://www.phoronix.com/scan.php?page=news_item&px=Dota-2-FidelityFX-Super-Res|title=Valve's Dota 2 Adds AMD FidelityFX Super Resolution|date=2021-06-24}}</ref>. The driver level implementation of FSR 1.0 is known as Radeon Super Resolution.
  
 
FSR 2.0 is a new version that changes the upscaler to a temporal one similar to DLSS and TAAU and was touted to have significantly better picture quality than FSR 1.0 at all modes while still not using machine learning algorithms, being open source and being supported on a wide range of hardware.
 
FSR 2.0 is a new version that changes the upscaler to a temporal one similar to DLSS and TAAU and was touted to have significantly better picture quality than FSR 1.0 at all modes while still not using machine learning algorithms, being open source and being supported on a wide range of hardware.
Announced on March 17 2022 alongside Radeon Super Resolution and Adrenalin 22.3.1, it released on May 12th 2022, with the first title supporting it being [[Deathloop]]<ref>{{Refurl|url=https://web.archive.org/web/20220317163733/https://community.amd.com/t5/gaming/announcing-and-first-look-at-amd-fidelityfx-super-resolution-2-0/ba-p/516395|title=Announcing and First Look at AMD FidelityFX Super Resolution 2.0|date=2022-03-17}}</ref> and the source code being published on June 22nd 2022.<ref>{{Refurl|url=https://web.archive.org/web/20220622135732/https://github.com/GPUOpen-Effects/FidelityFX-FSR2|title=FidelityFX Super Resolution 2.0.1 (FSR 2.0)|date=2022-06-22}}</ref> Reception for FSR 2.0 is positive as it has much improved picture quality compared to FSR 1.0 and can come close to DLSS 2.x's while still providing a similar performance uplift and working on non-RTX GPUs, even though it falls short at some fine detail or moving objects when compared to DLSS or native image.<ref>{{Refurl|url=https://www.youtube.com/watch?v=ZNJT6i8zpHQ|title=God of War PC: AMD FSR 2.0 vs Nvidia DLSS Image/ Motion Quality Face-Off|date=2022-06-24}}</ref>
+
Announced on March 17 2022 alongside Radeon Super Resolution and Adrenalin 22.3.1, it released on May 12th 2022, with the first title supporting it being [[Deathloop]]<ref>{{Refurl|url=https://web.archive.org/web/20220317163733/https://community.amd.com/t5/gaming/announcing-and-first-look-at-amd-fidelityfx-super-resolution-2-0/ba-p/516395|title=Announcing and First Look at AMD FidelityFX Super Resolution 2.0|date=2022-03-17}}</ref> and the source code being published on June 22nd 2022<ref>{{Refurl|url=https://web.archive.org/web/20220622135732/https://github.com/GPUOpen-Effects/FidelityFX-FSR2|title=FidelityFX Super Resolution 2.0.1 (FSR 2.0)|date=2022-06-22}}</ref>. Reception for FSR 2.0 is positive as it has much improved picture quality compared to FSR 1.0 and can come close to DLSS 2.x's while still providing a similar performance uplift and working on non-RTX GPUs, even though it falls short at some fine detail or moving objects when compared to DLSS or native image<ref>{{Refurl|url=https://www.youtube.com/watch?v=ZNJT6i8zpHQ|title=God of War PC: AMD FSR 2.0 vs Nvidia DLSS Image/ Motion Quality Face-Off|date=2022-06-24}}</ref>.
  
First major improvement to FSR 2.0, dubbed FSR 2.1, released on September 8th 2022, promising significant improvements in overall image quality and reducing ghosting and shimmering artifacts present, as highlighted in [[Farming Simulator 22]], being the first game to support this new iteration.<ref>{{Refurl|url=https://gpuopen.com/meet-fidelityfx-super-resolution-2-1/|title=It’s time to upscale FSR 2 even further: Meet FSR 2.1!|date=2022-09-09}}</ref>
+
First major improvement to FSR 2.0, dubbed FSR 2.1, released on September 8th 2022, promising significant improvements in overall image quality and reducing ghosting and shimmering artifacts present, as highlighted in [[Farming Simulator 22]], being the first game to support this new iteration<ref>{{Refurl|url=https://gpuopen.com/meet-fidelityfx-super-resolution-2-1/|title=It’s time to upscale FSR 2 even further: Meet FSR 2.1!|date=2022-09-09}}</ref>.
  
FSR 2.2 and FSR 3 were revealed during AMD's RDNA 3 announcement. While FSR 2.2 is a minor update, it is said to improve ghosting issues in cases where fast on-screen motion occurs. It was first released in [[Forza Horizon 5]] on November 8th 2022 and later in [[Need for Speed Unbound]] on December 2nd, 2022. FSR 2.2's source code was released on February 16th, 2023.<ref>{{Refurl|url=https://community.amd.com/t5/gaming/amd-fsr-2-2-now-available-on-gpuopen-and-fsr-supported-in-250/ba-p/586393|title=AMD FSR 2.2 Now Available on GPUOpen and FSR Supported in 250 Available and Upcoming Games|date=2023-02-18}}</ref>
+
FSR 2.2 and FSR 3 were revealed during AMD's RDNA 3 announcement. While FSR 2.2 is a minor update, it is said to improve ghosting issues in cases where fast on-screen motion occurs. It was first released in [[Forza Horizon 5]] on November 8th 2022 and later in [[Need for Speed Unbound]] on December 2nd, 2022. FSR 2.2's source code was released on February 16th, 2023<ref>{{Refurl|url=https://community.amd.com/t5/gaming/amd-fsr-2-2-now-available-on-gpuopen-and-fsr-supported-in-250/ba-p/586393|title=AMD FSR 2.2 Now Available on GPUOpen and FSR Supported in 250 Available and Upcoming Games|date=2023-02-18}}</ref>.
  
FSR 3 is an upcoming upgrade that will utilise AMD's Fluid Motion Frame technology, likely similar to DLSS's Frame Generation, that promises to achieve double the FPS of FSR 2. Further details about it are undisclosed as the feature is set to release in 2023.<ref>{{Refurl|url=https://www.digitaltrends.com/computing/amd-fsr-3-announcement-frame-generation/|title=AMD previews FSR 3.0, which now includes frame generation|date=2022-11-07}}</ref>
+
FSR 3 is an upcoming upgrade that will utilise AMD's Fluid Motion Frame technology, likely similar to DLSS's Frame Generation, that promises to achieve double the FPS of FSR 2. Further details about it are undisclosed as the feature is set to release in 2023<ref>{{Refurl|url=https://www.digitaltrends.com/computing/amd-fsr-3-announcement-frame-generation/|title=AMD previews FSR 3.0, which now includes frame generation|date=2022-11-07}}</ref>.
  
 
== Nvidia Image Scaling (NIS) ==
 
== Nvidia Image Scaling (NIS) ==
 
Nvidia Image Scaling is an image scaling technique that uses directional scaling in four directions along with an adaptive sharpening filter, basically a spatial upscaler similar to what FidelityFX Super Resolution 1.0 does. There are two versions of NIS: a driver-level version that can be applied system-wide, and an SDK that can be used by developers to implement functionality on a per-program basis.
 
Nvidia Image Scaling is an image scaling technique that uses directional scaling in four directions along with an adaptive sharpening filter, basically a spatial upscaler similar to what FidelityFX Super Resolution 1.0 does. There are two versions of NIS: a driver-level version that can be applied system-wide, and an SDK that can be used by developers to implement functionality on a per-program basis.
  
NIS was actually a part of the Nvidia Driver features since 2019 and the SDK was released for developers in November 2021. NIS didn't get much notoriety since it has only been implemented in a handful of games and its driver implementation is a bit confusing to use, although it can be used on any Nvidia GPU from Maxwell (GTX 745) and up unlike Radeon Super Resolution.<ref>{{Refurl|url=https://web.archive.org/web/20211116140617/https://www.digitaltrends.com/computing/what-is-nvidia-image-scaling/|title=What is Nvidia Image Scaling? How to use the upscaling feature|date=2021-11-16}}</ref>
+
NIS was actually a part of the Nvidia Driver features since 2019 and the SDK was released for developers in November 2021. NIS didn't get much notoriety since it has only been implemented in a handful of games and its driver implementation is a bit confusing to use, although it can be used on any Nvidia GPU from Maxwell (GTX 745) and up unlike Radeon Super Resolution<ref>{{Refurl|url=https://web.archive.org/web/20211116140617/https://www.digitaltrends.com/computing/what-is-nvidia-image-scaling/|title=What is Nvidia Image Scaling? How to use the upscaling feature|date=2021-11-16}}</ref>.
  
 
== MetalFX (MTLFX) ==
 
== MetalFX (MTLFX) ==
 
[https://developer.apple.com/documentation/metalfx MetalFX (MTLFX)] is an upscaling framework developed by Apple that integrates with their Metal graphics API and provides the ability to upscale a low-resolution image to a higher output resolution. The framework supports two different modes: a spatial upscaling mode akin to FSR 1.0, as well as a temporal anti-aliased upscaling mode similar to FSR 2.0.
 
[https://developer.apple.com/documentation/metalfx MetalFX (MTLFX)] is an upscaling framework developed by Apple that integrates with their Metal graphics API and provides the ability to upscale a low-resolution image to a higher output resolution. The framework supports two different modes: a spatial upscaling mode akin to FSR 1.0, as well as a temporal anti-aliased upscaling mode similar to FSR 2.0.
  
The framework requires a Mac with the M1 chip or an Intel-based Mac running macOS 13 or later.<ref>{{Refurl|url=https://developer.apple.com/documentation/metalfx/applying_temporal_antialiasing_and_upscaling_using_metalfx|title=Apple Developer Documentation - Applying temporal antialiasing and upscaling using MetalFX|date=2022-11-12}}</ref>
+
The framework requires a Mac with the M1 chip or an Intel-based Mac running macOS 13 or later<ref>{{Refurl|url=https://developer.apple.com/documentation/metalfx/applying_temporal_antialiasing_and_upscaling_using_metalfx|title=Apple Developer Documentation - Applying temporal antialiasing and upscaling using MetalFX|date=2022-11-12}}</ref>.
  
 
== Radeon Super Resolution (RSR) ==
 
== Radeon Super Resolution (RSR) ==
Radeon's equivalent of Nvidia's Image Scaling, a driver-level implementation of FSR 1.0 added in Adrenalin 22.3.1, only usable on Radeon RX 5000 GPUs and above and require games with exclusive full-screen mode initially.<ref>{{Refurl|url=https://web.archive.org/web/20220317212224/https://www.amd.com/en/support/kb/release-notes/rn-rad-win-22-3-1|title=AMD Software: Adrenalin Edition 22.3.1 Release Notes|date=2022-03-18}}</ref>.
+
Radeon's equivalent of Nvidia's Image Scaling, a driver-level implementation of FSR 1.0 added in Adrenalin 22.3.1, only usable on Radeon RX 5000 GPUs and above and require games with exclusive full-screen mode initially<ref>{{Refurl|url=https://web.archive.org/web/20220317212224/https://www.amd.com/en/support/kb/release-notes/rn-rad-win-22-3-1|title=AMD Software: Adrenalin Edition 22.3.1 Release Notes|date=2022-03-18}}</ref>.
  
In Adrenalin 22.7.1, RSR received enhanced support for borderless full-screen applications.<ref>{{Refurl|url=https://www.amd.com/en/support/kb/release-notes/rn-rad-win-22-7-1|title=AMD Software: Adrenalin Edition 22.7.1 Release Notes|date=2022-09-10}}</ref>.
+
In Adrenalin 22.7.1, RSR received enhanced support for borderless full-screen applications<ref>{{Refurl|url=https://www.amd.com/en/support/kb/release-notes/rn-rad-win-22-7-1|title=AMD Software: Adrenalin Edition 22.7.1 Release Notes|date=2022-09-10}}</ref>.
  
 
== Temporal Anti-Aliasing Upsample (TAAU) ==
 
== Temporal Anti-Aliasing Upsample (TAAU) ==
Line 63: Line 63:
  
 
== Xe Super Sampling (XeSS) ==
 
== Xe Super Sampling (XeSS) ==
XeSS, an image upscaling technology developed by Intel, combines the best of both DLSS and FSR into one package - it utilises a deep learning algorithm, while also being open source, cross-platform and vendor-agnostic. It upscales a lower-resolution image to a higher resolution one utilising one of the available instructions, in the order of best performance: XMX (Xe Matrix Extensions) available exclusively on Intel's own ARC GPUs, DP4a or Shader Model 6.4, which are both more broadly available, but come with reduced image quality and a higher performance cost.<ref>{{Refurl|url=https://web.archive.org/web/20210819171113/https://www.theverge.com/2021/8/19/22631061/intel-arc-gpu-alchemist-xe-ss-super-sampling-ai-architecture-day-preview|title=Intel shows off its answer to Nvidia’s DLSS, coming to Arc GPUs in 2022|date=2021-08-19}}</ref><ref>{{Refurl|url=https://youtu.be/q25yaUE4XH8?t=467|title=A New Player has Entered the Game &#124; Intel Arc Graphics - YouTube Premiere Stream|date=2022-03-31}}</ref>
+
XeSS, an image upscaling technology developed by Intel, combines the best of both DLSS and FSR into one package - it utilises a deep learning algorithm, while also being open source, cross-platform and vendor-agnostic. It upscales a lower-resolution image to a higher resolution one utilising one of the available instructions, in the order of best performance: XMX (Xe Matrix Extensions) available exclusively on Intel's own ARC GPUs, DP4a or Shader Model 6.4, which are both more broadly available, but come with reduced image quality and a higher performance cost<ref>{{Refurl|url=https://web.archive.org/web/20210819171113/https://www.theverge.com/2021/8/19/22631061/intel-arc-gpu-alchemist-xe-ss-super-sampling-ai-architecture-day-preview|title=Intel shows off its answer to Nvidia’s DLSS, coming to Arc GPUs in 2022|date=2021-08-19}}</ref><ref>{{Refurl|url=https://youtu.be/q25yaUE4XH8?t=467|title=A New Player has Entered the Game &#124; Intel Arc Graphics - YouTube Premiere Stream|date=2022-03-31}}</ref>.
  
First XeSS game released was [[The DioField Chronicle]] on September 22nd, 2022, followed by [[Shadow of the Tomb Raider]] and [[Death Stranding: Director's Cut]]. Visual Quality is close to DLSS 2.x, but lacking in certain areas like transparencies and it can produce unwanted moiré patterns. Performance improvement is mixed, where weaker DP4a GPUs, like the GTX 1060, and Shader Model 6.4 supported GPUs, like AMD's pre-RDNA line-up, don't see a benefit at all, meanwhile higher-end GPUs see performance similar to that of enabling DLSS, albeit a little lower.<ref>{{Refurl|url=https://www.techpowerup.com/review/shadow-of-the-tomb-raider-xess-vs-dlss/|title=Shadow of the Tomb Raider: XeSS vs. DLSS Comparison Review|date=2022-09-30}}</ref><ref>{{Refurl|url=https://www.youtube.com/watch?v=rfLwZy650s0|title=Exclusive - Intel XeSS ML Upscaling - The Digital Foundry Tech Review - XeSS vs DLSS vs Native!|date=2022-09-30}}</ref><ref>{{Refurl|url=https://www.tomshardware.com/news/shadow-of-the-tomb-raider-xess-tested|title=We Tested Intel's XeSS in Shadow of the Tomb Raider XeSS on Multiple GPUs|date=2022-09-30}}</ref>
+
First XeSS game released was [[The DioField Chronicle]] on September 22nd, 2022, followed by [[Shadow of the Tomb Raider]] and [[Death Stranding: Director's Cut]]. Visual Quality is close to DLSS 2.x, but lacking in certain areas like transparencies and it can produce unwanted moiré patterns. Performance improvement is mixed, where weaker DP4a GPUs, like the GTX 1060, and Shader Model 6.4 supported GPUs, like AMD's pre-RDNA line-up, don't see a benefit at all, meanwhile higher-end GPUs see performance similar to that of enabling DLSS, albeit a little lower<ref>{{Refurl|url=https://www.techpowerup.com/review/shadow-of-the-tomb-raider-xess-vs-dlss/|title=Shadow of the Tomb Raider: XeSS vs. DLSS Comparison Review|date=2022-09-30}}</ref><ref>{{Refurl|url=https://www.youtube.com/watch?v=rfLwZy650s0|title=Exclusive - Intel XeSS ML Upscaling - The Digital Foundry Tech Review - XeSS vs DLSS vs Native!|date=2022-09-30}}</ref><ref>{{Refurl|url=https://www.tomshardware.com/news/shadow-of-the-tomb-raider-xess-tested|title=We Tested Intel's XeSS in Shadow of the Tomb Raider XeSS on Multiple GPUs|date=2022-09-30}}</ref>.
  
 
== Supported games ==
 
== Supported games ==

Revision as of 08:26, 20 February 2023

Comparison of all 3 main upscalers in Hitman 3.
Comparison of all 3 main upscalers in Hitman 3.

For a list of games, see games with high-fidelity upscaling.

This article lists various high-fidelity image upscaling technologies used for video games.

Deep Learning Super Sampling (DLSS)

Deep Learning Super Sampling is a set of image upscaling algorithms developed by Nvidia for real-time use in video games, using deep learning to upscale lower-resolution images to a higher resolution that is accelerated through specialized hardware only present in the NVIDIA's RTX series GPUs[1].

DLSS was first announced with the release of the Nvidia RTX 20 series in September 2018 and the first titles featuring it released between then and March 2019. Needing per-game training and only being featured in a handful of games with generally subpar results, made DLSS (1.0) at the time rather disappointing and not recommended. An improved version of DLSS, unofficially labeled as 1.9, was shipped with the game Control in August 2019, providing better image quality than 1.0, although still generally worse than a native image of the upscaled resolution.[citation needed]

DLSS 2.0 was released in March 2020 providing much better picture quality, performance and adjustable quality options over previous versions, and since it didn't need per-game training it was implemented into many more games and is now generally recommended if you have a supported GPU[2].

DLSS 2.1 was released in September 2020 providing support for VR [Note 1], and introduced the Ultra performance quality option, meant for 8K gaming with the RTX 3090. Later versions of DLSS wouldn't provide much benefits as compared to before, mostly meant to fix issues with ghosting on fast moving objects, and these versions can be used on older DLSS 2.0 implementations via replacing a single .DLL file.

DLSS 3.0 was announced on September 20th in Nvidia's September GTC 2022 keynote keeping the same upscaling algorithm that DLSS 2.x.x utilises while adding two more features that being AI Frame Generation and integrating Nvidia Reflex. Frame Generation is touted to massively increase framerates as shown in a demo of Microsoft Flight Simulator (2020) running at over 100 FPS with DLSS 3.0 as opposed to 60 without, although Frame Generation has drawbacks like it being only possible on the 40 series Ada Lovelace GPUs because of a new optical flow accelerator and it increasing input latency significantly. Nvidia Reflex is being integrated into DLSS to lower to the increased latency given by Frame Generation, much in the same way it reduced latency when used normally. Both Frame Generation and Nvidia Reflex alongside the original Upscaling algorithm will have toggles allowing users to enable any of the features as they want. DLSS 3 rolled out into games and programs in October 2022, with Marvel's Spider-Man Remastered being one of the first games implementing it on 12 October, 2022[3][4].

FidelityFX Super Resolution (FSR)

FidelityFX Super Resolution is a set of open-source image upscaling algorithms developed by AMD for real-time use in video games, using traditional hand-written algorithms to upscale lower-resolution images to a higher resolution. It does not involve the use of machine-learning, unlike DLSS and XeSS, and runs on traditional shading units, thus doesn't need specialized hardware to function and can work on different vendors of GPUs.

FSR 1.0 was released in June 2021 with a handful of games supporting it and, although being a spatial upscaler, it generally provided a decent image at higher resolutions and quality presets (like 4K Ultra Quality), but lower resolutions and quality presets usually give a subpar image (at 1080p, or using the performance quality preset) - do note though that FSR's standardized presets are not enforced, so some titles such as Dota 2 offer resolution sliders instead[5]. The driver level implementation of FSR 1.0 is known as Radeon Super Resolution.

FSR 2.0 is a new version that changes the upscaler to a temporal one similar to DLSS and TAAU and was touted to have significantly better picture quality than FSR 1.0 at all modes while still not using machine learning algorithms, being open source and being supported on a wide range of hardware. Announced on March 17 2022 alongside Radeon Super Resolution and Adrenalin 22.3.1, it released on May 12th 2022, with the first title supporting it being Deathloop[6] and the source code being published on June 22nd 2022[7]. Reception for FSR 2.0 is positive as it has much improved picture quality compared to FSR 1.0 and can come close to DLSS 2.x's while still providing a similar performance uplift and working on non-RTX GPUs, even though it falls short at some fine detail or moving objects when compared to DLSS or native image[8].

First major improvement to FSR 2.0, dubbed FSR 2.1, released on September 8th 2022, promising significant improvements in overall image quality and reducing ghosting and shimmering artifacts present, as highlighted in Farming Simulator 22, being the first game to support this new iteration[9].

FSR 2.2 and FSR 3 were revealed during AMD's RDNA 3 announcement. While FSR 2.2 is a minor update, it is said to improve ghosting issues in cases where fast on-screen motion occurs. It was first released in Forza Horizon 5 on November 8th 2022 and later in Need for Speed Unbound on December 2nd, 2022. FSR 2.2's source code was released on February 16th, 2023[10].

FSR 3 is an upcoming upgrade that will utilise AMD's Fluid Motion Frame technology, likely similar to DLSS's Frame Generation, that promises to achieve double the FPS of FSR 2. Further details about it are undisclosed as the feature is set to release in 2023[11].

Nvidia Image Scaling (NIS)

Nvidia Image Scaling is an image scaling technique that uses directional scaling in four directions along with an adaptive sharpening filter, basically a spatial upscaler similar to what FidelityFX Super Resolution 1.0 does. There are two versions of NIS: a driver-level version that can be applied system-wide, and an SDK that can be used by developers to implement functionality on a per-program basis.

NIS was actually a part of the Nvidia Driver features since 2019 and the SDK was released for developers in November 2021. NIS didn't get much notoriety since it has only been implemented in a handful of games and its driver implementation is a bit confusing to use, although it can be used on any Nvidia GPU from Maxwell (GTX 745) and up unlike Radeon Super Resolution[12].

MetalFX (MTLFX)

MetalFX (MTLFX) is an upscaling framework developed by Apple that integrates with their Metal graphics API and provides the ability to upscale a low-resolution image to a higher output resolution. The framework supports two different modes: a spatial upscaling mode akin to FSR 1.0, as well as a temporal anti-aliased upscaling mode similar to FSR 2.0.

The framework requires a Mac with the M1 chip or an Intel-based Mac running macOS 13 or later[13].

Radeon Super Resolution (RSR)

Radeon's equivalent of Nvidia's Image Scaling, a driver-level implementation of FSR 1.0 added in Adrenalin 22.3.1, only usable on Radeon RX 5000 GPUs and above and require games with exclusive full-screen mode initially[14].

In Adrenalin 22.7.1, RSR received enhanced support for borderless full-screen applications[15].

Temporal Anti-Aliasing Upsample (TAAU)

TAAU is an upscaling technique that combines TAA and spatial upscaling into one pass. This allows the technique to converge to sharper images than if the spatial upscaling was performed as a later separate pass. However, it is important to note that there are other teams using similar techniques, but with slight variations in the implementation. Unreal Engine's TAAU implementation has been superseded by TSR.

Temporal Super Resolution (TSR)

TSR is a temporal upscaler quite similar to FSR 2.0 as it also requires motion vectors. It has been made by Epic Games for their new Unreal Engine 5, but has also been backported to UE4. The quality of the image is said by Digital Foundry to be better then FSR 1 but not as good as DLSS 2.3x[16].

Xe Super Sampling (XeSS)

XeSS, an image upscaling technology developed by Intel, combines the best of both DLSS and FSR into one package - it utilises a deep learning algorithm, while also being open source, cross-platform and vendor-agnostic. It upscales a lower-resolution image to a higher resolution one utilising one of the available instructions, in the order of best performance: XMX (Xe Matrix Extensions) available exclusively on Intel's own ARC GPUs, DP4a or Shader Model 6.4, which are both more broadly available, but come with reduced image quality and a higher performance cost[17][18].

First XeSS game released was The DioField Chronicle on September 22nd, 2022, followed by Shadow of the Tomb Raider and Death Stranding: Director's Cut. Visual Quality is close to DLSS 2.x, but lacking in certain areas like transparencies and it can produce unwanted moiré patterns. Performance improvement is mixed, where weaker DP4a GPUs, like the GTX 1060, and Shader Model 6.4 supported GPUs, like AMD's pre-RDNA line-up, don't see a benefit at all, meanwhile higher-end GPUs see performance similar to that of enabling DLSS, albeit a little lower[19][20][21].

Supported games

For a list of games, see games with high-fidelity upscaling.


Notes

  1. although only a few games implemented it way after its release

References

  1. NVIDIA DLSS: Your Questions, Answered - last accessed on 2019-02-16
  2. NVIDIA DLSS 2.0: A Big Leap In AI Rendering - last accessed on 2020-03-27
  3. NVIDIA DLSS 3: AI-Powered Performance Multiplier Boosts Frame Rates By Up To 4X - last accessed on 2022-09-25
  4. Marvel's Spider-Man Remastered v1.1011.1.0 Patch Notes - last accessed on 2022-11-07
  5. Valve's Dota 2 Adds AMD FidelityFX Super Resolution - last accessed on 2021-06-24
  6. Announcing and First Look at AMD FidelityFX Super Resolution 2.0 - last accessed on 2022-03-17
  7. FidelityFX Super Resolution 2.0.1 (FSR 2.0) - last accessed on 2022-06-22
  8. God of War PC: AMD FSR 2.0 vs Nvidia DLSS Image/ Motion Quality Face-Off - last accessed on 2022-06-24
  9. It’s time to upscale FSR 2 even further: Meet FSR 2.1! - last accessed on 2022-09-09
  10. AMD FSR 2.2 Now Available on GPUOpen and FSR Supported in 250 Available and Upcoming Games - last accessed on 2023-02-18
  11. AMD previews FSR 3.0, which now includes frame generation - last accessed on 2022-11-07
  12. What is Nvidia Image Scaling? How to use the upscaling feature - last accessed on 2021-11-16
  13. Apple Developer Documentation - Applying temporal antialiasing and upscaling using MetalFX - last accessed on 2022-11-12
  14. AMD Software: Adrenalin Edition 22.3.1 Release Notes - last accessed on 2022-03-18
  15. AMD Software: Adrenalin Edition 22.7.1 Release Notes - last accessed on 2022-09-10
  16. Ghostwire: Tokyo on PC debuts impressive new DLSS competitor - last accessed on 2022-03-17
  17. Intel shows off its answer to Nvidia’s DLSS, coming to Arc GPUs in 2022 - last accessed on 2021-08-19
  18. A New Player has Entered the Game | Intel Arc Graphics - YouTube Premiere Stream - last accessed on 2022-03-31
  19. Shadow of the Tomb Raider: XeSS vs. DLSS Comparison Review - last accessed on 2022-09-30
  20. Exclusive - Intel XeSS ML Upscaling - The Digital Foundry Tech Review - XeSS vs DLSS vs Native! - last accessed on 2022-09-30
  21. We Tested Intel's XeSS in Shadow of the Tomb Raider XeSS on Multiple GPUs - last accessed on 2022-09-30