huggingface

Neural Super Sampling is here!

image/png

Neural Super Sampling (NSS), a next-generation AI-powered upscaling solution from Arm is released for graphics and gaming developers to start experimenting today!

Elevated by machine learning

NSS is designed for real-time performance on future mobile devices with Arm Neural Technology. However, latency depends on implementation factors such as GPU configuration, resolution, and use case. In our Enchanted Castle demo video below, NSS reduced GPU workload by 50 percent. The model rendered at 540p and upscaled to 1080p in just 4ms in sustained performance setup.

Your browser does not support the video tag.

Learn about our NSS Model

Get started with our NSS model today.

If you want to go deeper check out the following resources:

How we trained the model

Check out the Neural Graphics Dataset: A collection of reference images and image sequences along with the corresponding motion, depth and other data required to train, validate and test neural super sampling algorithms.

The current version of the dataset includes a limited set of data for Neural Super Sampling to demonstrate how the NSS model development flow works. While this flow does not yet provide a comprehensive dataset for complete model (re)training, stay tuned for future releases of the Neural Graphics Model Gym where Arm will provide tools to capture and convert content for use in model training and retraining.

Get started experimenting with NSS today!

NSS has been integrated into Unreal Engine via two plugins, the NSS Plugin for UnrealĀ® Engine and UnrealĀ® NNE Plugin for ML extensions for Vulkan.

For step-by-step instructions on how to use NSS in UnrealĀ® Engine.See our learning paths:

readers loved this
@huggingface