Dean Leitersdorf introduces He himself crosses the zoom and type the prompt to make it feel like he's photographed a psychedelic mushroom. He gives words to an artificial intelligence model developed by his startup Decart, which operates live video in real time.
“I don't know what's going to happen,” Leitersdorf laughed, not before he transformed into a strange, golden aquatic version of Julius Caesar in the poncho.
Leitersdorf already looks a bit wild. This pen is carrying your back and doing acrobatics with your fingers. As we speak, when the model tries to predict what each new frame will look like, the image on his screen vibrates in a surreal way. Leitersdorf places his hands on his face and transforms with more feminine features. His pen jumps between different colors and shapes. He adds more prompts to take us into new psychedelic realms.
Decart's video-to-video model, Mirage is an impressive engineering feat and a sign of how AI can quickly shake up the live streaming industry. Tools like Openai's Sora can evoke increasingly realistic video footage at text prompts. Mirage now allows you to control video in real time.
On Thursday, Decart launches websites and apps where users can create their own videos and modify YouTube clips. The website offers several default themes, including “Anime”, “Dubai Skyline”, “Cyberpunk”, and “Palacio of Versailles”. During an interview, LeitersDorf uploads someone's clip Fortnite The scene changes from the familiar world of Battle Royale to an underwater version.
Decart's technology has great potential for games. In November 2024, the company demoed the game oasis It generated playable using a similar approach to Mirage Minecraft– Like the world on the spot. Users can approach the texture and then zoom out again to create a new playable scene within the game.
Manipulating live scenes in real time is even more computationally taxable. Decart wrote low-level code to narrow down high-speed calculations from the Nvidia chip. Mirage generates 20 frames per second at a resolution of 768 x 432, and latency of 100 milliseconds per frame.
