NVIDIA’s DLSS To Soon Switch Towards The Transformer Model, Bringing in Major Improvements To Upscaling Performance

NVIDIA is making a rather big transition with its DLSS technology, now switching to transformer models with massive upgrades.

NVIDIA DLSS To See The Switch From CNN To Transformer Model, Offering a 4x Uplift In Compute To Deliver Exceptional Image Quality

In the realm of upscaling technologies, NVIDIA’s DLSS has undoubtedly held its crown, not just because of the performance improvements it brings, but also because Team Green has created an ecosystem sufficient for a wide range of developers and gamers. Now, DLSS is slated for a significant upgrade: the switch from the traditional CNN-based approach to the adoption of a transformer model, which will likely bring in a wide range of improvements, from improved image quality to superior ray reconstruction.

NVIDIA’s DLSS Transformer model is now out of beta after six months of enablement work, indicating that we’ll soon see it integrated with titles over the internet. For a quick recap on what the Transformer model brings to the market, it uses a vision transformer that evaluates all the pixels in a particular frame and understands the importance of individual pixels. This is repeated across multiple frames to generate detailed pixels for enhanced visuals.

Through this method, the Transformer model uses double the parameters used in CNN and achieves better visuals in gameplay, less ghosting, and smoother edges. Not just this, but the Transformer model is said to support all RTX GPUs, which means that starting from the Turing architecture up to Blackwell, the DLSS Transformer will bring massive improvements. The exact scale of upgrades is yet to be seen, but NVIDIA claims that compared to CNNs, the Transformer model brings in massive uplifts to the upscaling process, so it is likely that we’ll see noticeable differences.

Given that the DLSS Transformer model is out of beta, we should expect an official update deploying the technology within the upcoming months.

News Source: Videocardz