Anonymous edits have been disabled on the wiki. If you want to contribute please login or create an account.

Warning for game developers: PCGamingWiki staff members will only ever reach out to you using the official press@pcgamingwiki.com mail address.
Be aware of scammers claiming to be representatives or affiliates of PCGamingWiki who promise a PCGW page for a game key.

Difference between revisions of "Glossary:High-fidelity upscaling"

From PCGamingWiki, the wiki about fixing PC games
m (→‎DLSS Frame Generation: rephrased section a bit)
(added XeSS 1.1)
Line 57: Line 57:
 
XeSS, an image upscaling technology developed by Intel, combines the best of both DLSS and FSR into one package - it utilises a deep learning algorithm, while also being open source, cross-platform and vendor-agnostic. It upscales a lower-resolution image to a higher resolution one utilising one of the available instructions, in the order of best performance: XMX (Xe Matrix Extensions) available exclusively on Intel's own ARC GPUs, DP4a or Shader Model 6.4, which are both more broadly available, but come with reduced image quality and a higher performance cost.<ref>{{Refurl|url=https://web.archive.org/web/20210819171113/https://www.theverge.com/2021/8/19/22631061/intel-arc-gpu-alchemist-xe-ss-super-sampling-ai-architecture-day-preview|title=Intel shows off its answer to Nvidia’s DLSS, coming to Arc GPUs in 2022|date=2021-08-19}}</ref>
 
XeSS, an image upscaling technology developed by Intel, combines the best of both DLSS and FSR into one package - it utilises a deep learning algorithm, while also being open source, cross-platform and vendor-agnostic. It upscales a lower-resolution image to a higher resolution one utilising one of the available instructions, in the order of best performance: XMX (Xe Matrix Extensions) available exclusively on Intel's own ARC GPUs, DP4a or Shader Model 6.4, which are both more broadly available, but come with reduced image quality and a higher performance cost.<ref>{{Refurl|url=https://web.archive.org/web/20210819171113/https://www.theverge.com/2021/8/19/22631061/intel-arc-gpu-alchemist-xe-ss-super-sampling-ai-architecture-day-preview|title=Intel shows off its answer to Nvidia’s DLSS, coming to Arc GPUs in 2022|date=2021-08-19}}</ref>
  
−
First XeSS game released was [[The DioField Chronicle]] on September 22nd, 2022, followed by [[Shadow of the Tomb Raider]] and [[Death Stranding: Director's Cut]]. Visual Quality is close to DLSS 2.x, but lacking in certain areas like transparencies and it can produce unwanted moiré patterns. Performance improvement is mixed, where weaker DP4a GPUs, like the GTX 1060, and Shader Model 6.4 supported GPUs, like AMD's pre-RDNA line-up, don't see a benefit at all, meanwhile higher-end GPUs see performance similar to that of enabling DLSS, albeit a little lower.<ref>{{Refurl|url=https://www.youtube.com/watch?v=rfLwZy650s0|title=Exclusive - Intel XeSS ML Upscaling - The Digital Foundry Tech Review - XeSS vs DLSS vs Native!|date=2022-09-30}}</ref><ref>{{Refurl|url=https://www.tomshardware.com/news/shadow-of-the-tomb-raider-xess-tested|title=We Tested Intel's XeSS in Shadow of the Tomb Raider XeSS on Multiple GPUs|date=2022-09-30}}</ref>
+
First XeSS 1.0 game released was [[The DioField Chronicle]] on September 22nd, 2022, followed by [[Shadow of the Tomb Raider]] and [[Death Stranding: Director's Cut]]. Visual Quality is close to DLSS 2.x, but lacking in certain areas like transparencies and it can produce unwanted moiré patterns. Performance improvement is mixed, where weaker DP4a GPUs, like the GTX 1060, and Shader Model 6.4 supported GPUs, like AMD's pre-RDNA line-up, don't see a benefit at all, meanwhile higher-end GPUs see performance similar to that of enabling DLSS, albeit a little lower.<ref>{{Refurl|url=https://www.youtube.com/watch?v=rfLwZy650s0|title=Exclusive - Intel XeSS ML Upscaling - The Digital Foundry Tech Review - XeSS vs DLSS vs Native!|date=2022-09-30}}</ref><ref>{{Refurl|url=https://www.tomshardware.com/news/shadow-of-the-tomb-raider-xess-tested|title=We Tested Intel's XeSS in Shadow of the Tomb Raider XeSS on Multiple GPUs|date=2022-09-30}}</ref>
 +
 
 +
XeSS 1.1 was revealed by Intel on 23 March 2023 and released the following day, promising improved image quality and performance for XMX and DP4A models. XeSS uses DLL files and thus game implementations could be independantly updated by users, although results may be worse in performance.<ref>{{Refurl|url=https://www.youtube.com/watch?v=hPl82IsJcAw|title=XeSS / High Quality Super Sampling from iGPU to dGPU / Intel Software|date=2023-03-25}}<br>{{Refurl|url=https://github.com/intel/xess/releases/tag/v1.1.0|title=XeSS SDK 1.1.0|date=2023-03-25}}<br>{{Refcheck|user=Mine18|date=2023-03-25|comment=Swapping DLLs in Shadow of the Tomb Raider led to worse performance and slightly better image quality on the SM 6.4 model.}}</ref>
  
 
=== Temporal Anti-Aliasing Upsample (TAAU) ===
 
=== Temporal Anti-Aliasing Upsample (TAAU) ===

Revision as of 10:56, 25 March 2023

Comparison of all 3 main upscalers in Hitman 3.
Comparison of all 3 main upscalers in Hitman 3.

Graphics and video

Resolutions

Video settings

Hardware

For a list of games, see games with high-fidelity upscaling.

This article lists various high-fidelity image upscaling technologies used for video games. See the Comparisons section for a couple of comparisons of various high-fidelity upscaling methods.

Nvidia

Deep Learning Super Sampling (DLSS)

Deep Learning Super Sampling is a set of image upscaling algorithms developed by Nvidia for real-time use in video games, using deep learning to upscale lower-resolution images to a higher resolution that is accelerated through specialized hardware only present in the NVIDIA's RTX series GPUs.[1]

DLSS was first announced with the release of the Nvidia RTX 20 series in September 2018 and the first titles featuring it released between then and March 2019. Needing per-game training and only being featured in a handful of games with generally subpar results, made DLSS (1.0) at the time rather disappointing and not recommended. An improved version of DLSS, unofficially labeled as 1.9, was shipped with the game Control in August 2019, providing better image quality than 1.0, but only at certain qualities and resolutions such as 4K.[2]

DLSS 2.0 was released in March 2020 providing much better picture quality, performance and adjustable quality options over previous versions, and since it didn't need per-game training it was implemented into many more games and is now generally recommended if you have a supported GPU.[3]

DLSS 2.1 was released in September 2020 providing support for VR [Note 1], and introduced the Ultra performance quality option, meant for 8K gaming with the RTX 3090. Later versions of DLSS wouldn't provide much benefits as compared to before, mostly meant to fix issues with ghosting on fast moving objects, and these versions can be used on older DLSS 2.0 implementations via replacing a single .DLL file.

DLSS Frame Generation

Although technically not an upscaler itself, DLSS Frame Generation is documented here due to the lack of another appropriate place for it.

DLSS Frame Generation was announced as "DLSS 3" (not to be mistaken with DLSS DLL v3.1.1) in Nvidia's GTC 2022 keynote on September 20th, keeping the same upscaling algorithm that DLSS 2.x.x utilises (now called Super Resolution) while adding two more features: Deep Learning Frame Generation, and Nvidia Reflex integration.[4] Frame Generation was touted to massively increase framerates as shown in a demo of Microsoft Flight Simulator (2020) running at over 100 FPS using it as opposed to 60 without, although the technology has drawbacks like increased input latency (hence the Nvidia Reflex integration) and only being available on Ada Lovelace GPUs and newer due to the reliance of a new optical flow accelerator. Both Frame Generation and Nvidia Reflex alongside the original upscaling algorithm typically have separate toggles allowing users to combine features as desired.

Despite being a proprietary Nvidia technology, Frame Generation does not have a dependency on DLSS Super Resolution or Nvidia Image Scaling, and can be enabled alongside other vendors' upscaling tech provided the game allows it.[5]

DLSS Frame Generation rolled out into games and programs in late 2022 with Marvel's Spider-Man Remastered being one of the first games implementing it on 12 October, 2022.[6] Nvidia eventually[citation needed] dropped the "DLSS 3" name in favor of "DLSS Frame Generation" to minimize user confusion as the DLSS 2/Super Resolution technology was updated to v3.1.1, and a game can make use v3 of the DLSS Super Resolution technology without including Frame Generation support.

Nvidia Image Scaling (NIS)

Nvidia Image Scaling is an image scaling technique that uses directional scaling in four directions along with an adaptive sharpening filter, basically a spatial upscaler similar to what FidelityFX Super Resolution 1.0 does. There are two versions of NIS: a driver-level version that can be applied system-wide, and an SDK that can be used by developers to implement functionality on a per-program basis.

NIS was actually a part of the Nvidia Driver features since 2019 and the SDK was released for developers in November 2021. NIS didn't get much notoriety since it has only been implemented in a handful of games and its driver implementation is a bit confusing to use, although it can be used on any Nvidia GPU from Maxwell (GTX 745) and up unlike Radeon Super Resolution.[7]

AMD

FidelityFX Super Resolution (FSR)

FidelityFX Super Resolution is a set of open-source image upscaling algorithms developed by AMD for real-time use in video games, using traditional hand-written algorithms to upscale lower-resolution images to a higher resolution. It does not involve the use of machine-learning, unlike DLSS and XeSS, and runs on traditional shading units, thus doesn't need specialized hardware to function and can work on different vendors of GPUs.

FSR 1.0 was released in June 2021 with a handful of games supporting it and, although being a spatial upscaler, it generally provided a decent image at higher resolutions and quality presets (like 4K Ultra Quality), but lower resolutions and quality presets usually give a subpar image (at 1080p, or using the performance quality preset) - do note though that FSR's standardized presets are not enforced, so some titles such as Dota 2 offer resolution sliders instead.[8] The driver level implementation of FSR 1.0 is known as Radeon Super Resolution.

FSR 2.0 is a new version that changes the upscaler to a temporal one similar to DLSS and TAAU and was touted to have significantly better picture quality than FSR 1.0 at all modes while still not using machine learning algorithms, being open source and being supported on a wide range of hardware. Announced on March 17 2022 alongside Radeon Super Resolution and Adrenalin 22.3.1, it released on May 12th 2022, with the first title supporting it being Deathloop.[9] and the source code being published on June 22nd 2022[10] Reception for FSR 2.0 is positive as it has much improved picture quality compared to FSR 1.0 and can come close to DLSS 2.x's while still providing a similar performance uplift and working on non-RTX GPUs, even though it falls short at some fine detail or moving objects when compared to DLSS or native image.[11]

First major improvement to FSR 2.0, dubbed FSR 2.1, released on September 8th 2022, promising significant improvements in overall image quality and reducing ghosting and shimmering artifacts present, as highlighted in Farming Simulator 22, being the first game to support this new iteration.[12]

FSR 2.2 and FSR 3 were revealed during AMD's RDNA 3 announcement. FSR 2.2 is a minor update and is said to improve ghosting issues in cases where fast on-screen motion occurs. It was first released in Forza Horizon 5 on November 8th 2022 and later in Need for Speed Unbound on December 2nd, 2022. FSR 2.2's source code was released on February 16th, 2023.[13]

FSR 3 is an upcoming upgrade that will utilise AMD's Fluid Motion Frame technology, likely similar to DLSS Frame Generation, that promises to achieve double the FPS of FSR 2. Further details about it are undisclosed as the feature is set to release in 2023.[14]

The framework requires a Mac with the M1 chip or an Intel-based Mac running macOS 13 or later.[15]

Radeon Super Resolution (RSR)

Radeon's equivalent of Nvidia's Image Scaling, a driver-level implementation of FSR 1.0 added in Adrenalin 22.3.1, only usable on Radeon RX 5000 GPUs and above and require games with exclusive full-screen mode initially.[16]

In Adrenalin 22.7.1, RSR received enhanced support for borderless full-screen applications.[17]

Misc.

Xe Super Sampling (XeSS)

XeSS, an image upscaling technology developed by Intel, combines the best of both DLSS and FSR into one package - it utilises a deep learning algorithm, while also being open source, cross-platform and vendor-agnostic. It upscales a lower-resolution image to a higher resolution one utilising one of the available instructions, in the order of best performance: XMX (Xe Matrix Extensions) available exclusively on Intel's own ARC GPUs, DP4a or Shader Model 6.4, which are both more broadly available, but come with reduced image quality and a higher performance cost.[18]

First XeSS 1.0 game released was The DioField Chronicle on September 22nd, 2022, followed by Shadow of the Tomb Raider and Death Stranding: Director's Cut. Visual Quality is close to DLSS 2.x, but lacking in certain areas like transparencies and it can produce unwanted moiré patterns. Performance improvement is mixed, where weaker DP4a GPUs, like the GTX 1060, and Shader Model 6.4 supported GPUs, like AMD's pre-RDNA line-up, don't see a benefit at all, meanwhile higher-end GPUs see performance similar to that of enabling DLSS, albeit a little lower.[19][20]

XeSS 1.1 was revealed by Intel on 23 March 2023 and released the following day, promising improved image quality and performance for XMX and DP4A models. XeSS uses DLL files and thus game implementations could be independantly updated by users, although results may be worse in performance.[21]

Temporal Anti-Aliasing Upsample (TAAU)

Released alongside Unreal Engine 4.19, TAAU is an upscaling technique that combines TAA and spatial upscaling into one pass. This allows the technique to converge to sharper images than if the spatial upscaling was performed as a later separate pass. However, it is important to note that there are other teams using similar techniques, but with slight variations in the implementation. Unreal Engine's TAAU implementation has been superseded by TSR.[22]

Temporal Super Resolution (TSR)

TSR is a temporal upscaler quite similar to FSR 2.0 as it also requires motion vectors. It has been made by Epic Games for their new Unreal Engine 5, but has also been backported to UE4. The quality of the image is said by Digital Foundry to be better then FSR 1 but not as good as DLSS 2.x.[23]

MetalFX (MTLFX)

MetalFX (MTLFX) is an upscaling framework developed by Apple that integrates with their Metal graphics API and provides the ability to upscale a low-resolution image to a higher output resolution. The framework supports two different modes: a spatial upscaling mode akin to FSR 1.0, as well as a temporal anti-aliased upscaling mode similar to FSR 2.0.

Supported games

For a list of games, see games with high-fidelity upscaling.

Comparisons

  • A comparison between DLSS 1 at 4K and 1800p upscaled with TAA in Battlefield V.

  • A comparison between DLSS 1.9 at 4K and native 4K in Control.

  • A comparison between DLSS 2 Quality mode at 4K and native 4K in Wolfenstein: Youngblood

  • A comparison between FSR 1 Ultra Quality and Quality modes at 4K and native 4K in Anno 1800.

  • A comparison between FSR 2 Quality modes at 4K and native 4K in Deathloop.

  • A comparison between DLSS 2 Quality, FSR 2 Quality, and XeSS XMX Quality in Marvel's Spider-Man Remastered.


Notes

  1. ↑ Although only a few games implemented it way after its release.

References

  1. ↑ NVIDIA DLSS: Your Questions, Answered - last accessed on 2019-02-16
  2. ↑ Nvidia DLSS in 2020: Stunning Results - last accessed on 2023-02-20
  3. ↑ NVIDIA DLSS 2.0: A Big Leap In AI Rendering - last accessed on 2020-03-27
  4. ↑ NVIDIA DLSS 3: AI-Powered Performance Multiplier Boosts Frame Rates By Up To 4X - last accessed on 2022-09-25
  5. ↑ AMD's FSR 3.0 emulated: Frame Generation with DLSS 3.0, FSR 2.1 and XeSS in benchmark and quality comparison - last accessed on 2023-02-23
    "We asked NVIDIA if this was intentional with the settings menus and got the confident answer that it was a feature and not an oversight, while they also pointed out that DLSS would provide the best picture quality, but that the frame generation would in principle also work with all other methods like AMD’s FSR and Intel’s XeSS."
  6. ↑ Marvel's Spider-Man Remastered v1.1011.1.0 Patch Notes - last accessed on 2022-11-07
  7. ↑ What is Nvidia Image Scaling? How to use the upscaling feature - last accessed on 2021-11-16
  8. ↑ Valve's Dota 2 Adds AMD FidelityFX Super Resolution - last accessed on 2021-06-24
  9. ↑ Announcing and First Look at AMD FidelityFX Super Resolution 2.0 - last accessed on 2022-03-17
  10. ↑ FidelityFX Super Resolution 2.0.1 (FSR 2.0) - last accessed on 2022-06-22
  11. ↑ God of War PC: AMD FSR 2.0 vs Nvidia DLSS Image/ Motion Quality Face-Off - last accessed on 2022-06-24
  12. ↑ It’s time to upscale FSR 2 even further: Meet FSR 2.1! - last accessed on 2022-09-09
  13. ↑ AMD FSR 2.2 Now Available on GPUOpen and FSR Supported in 250 Available and Upcoming Games - last accessed on 2023-02-18
  14. ↑ AMD previews FSR 3.0, which now includes frame generation - last accessed on 2022-11-07
  15. ↑ Apple Developer Documentation - Applying temporal antialiasing and upscaling using MetalFX - last accessed on 2022-11-12
  16. ↑ AMD Software: Adrenalin Edition 22.3.1 Release Notes - last accessed on 2022-03-18
  17. ↑ AMD Software: Adrenalin Edition 22.7.1 Release Notes - last accessed on 2022-09-10
  18. ↑ Intel shows off its answer to Nvidia’s DLSS, coming to Arc GPUs in 2022 - last accessed on 2021-08-19
  19. ↑ Exclusive - Intel XeSS ML Upscaling - The Digital Foundry Tech Review - XeSS vs DLSS vs Native! - last accessed on 2022-09-30
  20. ↑ We Tested Intel's XeSS in Shadow of the Tomb Raider XeSS on Multiple GPUs - last accessed on 2022-09-30
  21. ↑ XeSS / High Quality Super Sampling from iGPU to dGPU / Intel Software - last accessed on 2023-03-25
    XeSS SDK 1.1.0 - last accessed on 2023-03-25
    Verified by User:Mine18 on 2023-03-25
    Swapping DLLs in Shadow of the Tomb Raider led to worse performance and slightly better image quality on the SM 6.4 model.
  22. ↑ Unreal Engine 4.19 Released! - last accessed on 2023-02-20
  23. ↑ Ghostwire: Tokyo on PC debuts impressive new DLSS competitor - last accessed on 2022-03-17