Use AI motion capture to reflect movements to 3D characters in real time.
AI is 100% becoming the hottest topic in film and video production, as we’ve been covering at No Film School almost daily for the last few months.from Crazy new generative AI possibilities To An iPhone that recreates professional video productionAI is (for better or worse) revolutionizing entire industries.
AI definitely has a scary element to it in that it could replace jobs and entire industries, but there are also some new technologies that show the potential to make the world of video simply easier and less complex. I have.
One of these new technologies came to us from this year’s NAB and Cannes Film Festival with new technology announcements. invisible solution Technology bundle for real-time markerless motion capture.Developed in partnership with Move.aithis new tool promises to remove the need for markers, wearable suits, or lengthy calibration setups as a way to allow anyone to translate their movements into their character rig in real time.
Let’s take a look at this new real-time AI-driven motion capture tool and explore how it works.
Invisible AI motion capture tool
Built to work within the environment disguise designer software, the solution leverages Move.ai’s patented Invisible real-time markerless motion capture software to use AI to extract natural human motion from video. Capable of tracking up to two people at once, this new technology is a faster, easier, and ultimately more cost-effective live motion capture tool on a video set, or perhaps a live production (or meta-production) stage. I promise to be .
Especially for live broadcasts, the app is designed to provide motion capture data, which the talent can use on set to create feature-triggered graphs and scene changes, as well as accurate shadows. can drive It’s a process you can use or share in the metaverse too…if that’s your preference, of course.
And for live events, Invisible software integrates with the scalable processing capabilities of other Disguise hardware to ensure high-fidelity, real-time output to any LED stage or virtual production volume of any size, making it easy to adapt to virtual setups. Provides even more advanced control and features.
AI motion capture for movies and videos
However, the real exciting use of this Invisible AI motion capture tool is in the real world of film and video production. This allows you to capture 3D characters that can interact seamlessly with real-life actors, or drive motion-triggered effects such as smoke and fire. We are working on a suitable set.
“We are very happy to have created a demo for the Invisible solutions showcase at Cannes. By working directly with disguise and Move.ai, it looks and works thanks to the seamless integration between both platforms. Unreal Engine’s markerless motion tracking opens up a world of creative possibilities, allowing directors, designers, and artists to see a high-quality final product at every stage of production. It allows us to get more done, faster and more reliably, while at the same time.” — Svet Lapcheva, Executive Producer/Client Partner at FutureDeluxe.
This new markerless motion capture tracking technology, combined with other tools such as Unreal Engine, opens up the possibility of custom environments and virtual productions typically reserved only for the biggest budget studio productions with advanced equipment and gear. It opens up the whole world of sex.
The future of motion capture
Ultimately, as with many video-related industries, the future of motion capture is set to change rapidly with upcoming advances in AI.
Especially if you want to get started with this Invisible tool, it might be best to consider one of Disguise’s bundles for various setups. At least one disguise is required to enable real-time markerless motion capture using the Invisible solution vx again GX The machine is also required for graphics processing and one disguise rxⅡ for real-time rendering.
But if you’re just starting to keep an eye on these new advancements and plan how to integrate markerless motion capture into your videos and projects, keep an eye out for upcoming updates and features. Learn more about the upcoming AI revolution.
Also, feel free to share your thoughts on this new AI motion capture technology in the comments below.
