This artificial intelligence tool renders video game characters ‘realistically’ – but how realistic can game graphics be?



In recent times, AI has become an increasingly popular marketing tool in video game graphics.

NVIDIA uses it with their DLSS, for example, which allows them to offer a significant performance boost when running the most demanding titles of the current generation.

(Photo: Steam)

But other than that, the AI ​​has also taken over the rendering of the game’s graphics in a much more “visual” way.

A perfect example is a specific AI program called StyleCLIP, which would take the 3D rendered faces of popular video game characters and make them more photorealistic, according to ScreenRant.

IGN tried to use the AI ​​tool and tweeted some of the images obtained. Looking at these photos, the characters look so much more realistic:

The characters they used the AI ​​tool on included Kratos from the “God of War” series, Nathan Drake from “Uncharted”, Commander Shepard from “Mass Effect” and Trevor, the famous “GTA V”.

Now, those images certainly look photorealistic, but can video game graphics really reach that level bordering on Uncanny Valley?

AI-based photorealism: small steps

Artificial intelligence-based photorealism in real-time 3D rendered graphics is still a long way off. But the revolution has already started with a few technologies, the most important of which is hardware-accelerated ray tracing.

Before the advent of real-time ray tracing with the NVIDIA RTX 2000 series of graphics cards, video games were rendered in a more traditional and handcrafted way. Shadows, reflections and lighting illustrate this example perfectly.

laser tracing

(Photo: NVIDIA)

Without ray tracing, game developers can only render reflections and shadows by placing them by hand, while taking into account the lighting quality of a specific scene.

What’s even more difficult is that developers also have to consider the different camera angles a player can make while playing, the position of the light source in the stage at different times of the day. , etc. This makes the development cycle extremely tedious, which is why most games these days take years to make.

But with ray tracing, this is all moot. This is because the technology is able to cast realistic reflections and shadows making the lighting in the game behave as it literally does in real life.

It works by using an algorithm to simulate actual light rays from a source, then plotting all the paths those beams will take in the scene.

The end result are shadows, reflections, and lighting which, if implemented correctly, are almost indistinguishable from real life.

Read also: NVIDIA just brought Ray Tracing to entry-level GPUs, but is “RTX On” even worth the performance penalty?

Photogrammetry and texture work

Another thing that could lead to photorealistic graphics is photogrammetry.

First gaining popularity for its use in the 2014 game “The Vanishing of Ethan Carter”, this rendering technology involves the use of real-world photographs and the creation of in-game elements, often textures, to from these.

The developers of “The Vanishing of Ethan Carter” detailed the technology they used in a Polygon article.

They used software called Photoscan, which “looked” at the photos they took until it managed to reproduce every detail it saw.

It then produces a literal digital copy of the characteristics of the photograph, which can be used to create hyperrealistic game worlds.

Disappearance of Ethan Carter's screen

(Photo: Steam)

Photogrammetry is often linked to the use of AI, according to ScienceDirect.

The answer is simple: No human would have the ability to completely reproduce the finest details, for example, of a patch of soil or the surface of a rock. Only AI has the right amount of processing power to process this data.

Will the games of the future be indistinguishable from real life?

Photorealism has been the goal of so many game developers since the advent of true real-time 3D graphics in the 90s. And you can see the visual improvements with each subsequent game generation.

Artificial intelligence will help propel 3D rendered video game graphics even further, and that’s a guarantee.

Related: ‘Forza Horizon 5’ Ray Tracing Improves Not Only Visuals But Also Audio, Better Experience For Xbox Series X / S Users

This article is the property of Tech Times

Written by RJ Pierce

2021 All rights reserved. Do not reproduce without permission.

Source link

Leave A Reply

Your email address will not be published.