This AI model creates videos in real time

AI Video & Visuals


The grid of 15 images shows a woman with shoulder-length brown hair wearing a black top in various poses and expressions, touching her hair and facing in different directions.
This AI is controlled in real time. She is playing the prompt within milliseconds of it being typed.

The runway demonstrated new AI video technology that creates HD images in real time. The technology could be an exciting development in the world of entertainment, but some say it will make it even harder to spot fakes.

AI, along with misinformation and bad actors, are already undermining what people see online. But real-time AI video is an even bigger step, and the technology could be used to deceive people in the real world, as someone controlling an AI avatar reacts and reacts to a real person.

Runway showed off the technology at NVIDIA GTC last week. The as-yet-unnamed model can generate images from a prompt literally in the blink of an eye (in just 100 milliseconds). If you’ve never used an AI video model before, it typically takes seconds, if not minutes, from the time you enter a prompt until you receive an AI video about your model from Google or OpenAI.

interesting engineering We report that this model will run on NVIDIA’s next-generation Vera Rubin architecture. The technology website says the model works close to how game engines render graphics, allowing frames to be streamed continuously.

This means that there could theoretically be live broadcasts and streams featuring AI characters and worlds that react to whatever happens.

It also affects the game. In January, Google announced Project Genie, a world-building tool that lets users create their own environments from a single photo or text prompts that unfold in real time.

A woman with wavy brown hair stretches one arm up and the other arm out to the side. She seems to be concentrating. The interface around her displays prompts explaining her movements and video editing tools.
When a prompt is entered, the AI ​​avatar responds immediately.

interesting engineering He points out that the technology still has limitations. For example, AI tends to wander from its source the more iterates, making it a challenge to maintain character consistency. But with companies like NVIDIA and their unlimited financial resources, great advances will continue to come.


Image credits: runway





Source link