2019

GauGAN

NVIDIA announces GauGAN, an img2img model that converts user-drawn segmentation maps to landscape photography in realtime

GauGAN 2 is now available within NVIDIA Canvas

PHYPHYGITALISM,

a studio that specializes in mixed reality, goes on to create a realtime implementation in Unity

Jon Warlick

creates a video documenting his process of rendering each frame out of Blender through GauGAN

. . . and many others

demonstrate the same shared sentiment that realtime ai image generation, even when lacking in temporal consistency, is a fascinating development in emerging tech.

img2img example

I was tremendously inspired by seeing what amounted to the first application to leverage ai image generation in realtime, and took it upon myself to create a previs environment in Unity and run each frame through GauGAN, manually.