Adobe research team develops AI “VideoGigaGAN'' that can upscale videos while restoring details

AI Video & Visuals



Adobe says “ video gigagan ”, an AI that can upscale videos. Compared to existing video upscaling AI, VideoGigaGAN can generate clearer images and reduce flickering between frames.

video gigagan

https://videogigagan.github.io/

As an example of the power of VideoGigaGAN, Adobe released a demo that upscales a 128 x 128 pixel video by 8x in both width and height to 1024 x 1024 pixels.

Below is a side-by-side comparison of the original image (left) and an enlarged image of the same size (right). You can see that the image has been upscaled to a fairly high quality.

When you enlarge the image of the waterfall, it looks like this. The enlarged image (right) shows water flow and plants more clearly than the original image (left).

According to Adobe, VideoGigaGAN is superior to existing video upscaling AI in terms of detail reproduction and flicker reduction. Adobe emphasizes the high performance of VideoGigaGAN by comparing the processing results of video upscaling AI such as VideoGigaGAN.

BasicVSR (top left), BasicVSR++ (top right), and TTVSR (bottom left) and VideoGigaGAN (bottom right).

For technical details about VideoGigaGAN, please refer to the following link:

[2404.12388] VideoGigaGAN: Aiming for detailed video super resolution
https://arxiv.org/abs/2404.12388





Source link

Leave a Reply

Your email address will not be published. Required fields are marked *