Creative studio staff fights sickle cell disease with AI short animation

Applications of AI


Editor’s Note: This post was Introduction to omnivores A series featuring individual creators and developers who use . NVIDIA Omniverse Accelerate your 3D workflows and create virtual worlds.

Creative studio Elara Systems does not shy away from sensitive subject matter in its work.

One of the company’s missions for its most recent client was to use fun and engaging visuals to normalize what could be considered a sensitive health issue, resulting in improved medical outcomes.

Working with Boston Scientific and the Sickle Cell Society, the Elara Systems team used the NVIDIA Omniverse development platform to connect 3D pipelines and build metaverse applications to create character-driven 3D medical animations.

The purpose of this video is to help adolescents suffering from sickle cell disease, if they develop symptoms like priapism (a long-lasting, painful erection that can lead to permanent physical damage), adults or The goal is to help people understand the importance of communicating immediately with a medical professional.

“Obviously, this is very scary for young people,” said Benjamin Samar, technical director at Elara Systems. “We wanted to make it clear that coexisting and managing this condition is achievable and, most importantly, there is nothing to be ashamed of.”

To bring the project to life, the Elara Systems team provided the USD Composer app, generative AI-powered Audio2Face and Audio2Gesture, as well as Adobe Substance 3D Painter, Autodesk 3ds Max, Autodesk Maya and other popular 3D content creation tools. We are looking at the Omniverse connector. Tools like Blender, Epic Games Unreal Engine, Reallusion iClone, and Unity.

For the sickle cell project, the team utilized Adobe Substance 3D Painter to organize various 3D environments and apply custom textures to all five characters. Adobe After Effects was used to composite the rendered content into one cohesive short film.

It’s all possible thanks to the open and extensible Universal Scene Description (USD) framework that Omniverse is built on.

“USD is so powerful that it solves a ton of problems many people don’t even know exist when it comes to collaborating effectively on a project,” Samar said. “For example, you can build a scene in Substance 3D Painter, export it to USD format, and with one click he can bring it into USD Composer. Shaders are automatically generated and linked, so if you need It can be further customized.”

Awareness-raising animation

Rooting the sickle cell awareness campaign in a relatable personal story was “a human approach to clinical discourse,” he says, spanning nearly two decades of video production, motion graphics, 3D animation and augmented reality. Samar, who has industry experience in

The team accomplished this strategy through a 3D character named Leon. Leon, a football enthusiast, recounts his experience of a rough day when he was 13 and first learned how to manage sickle cell disease.

The 3D character Leon in the Omniverse viewport.

The project began with an in-depth discussion of the goals of the Sickle Cell Society short story, followed by the creation of a screenplay, storyboards, and various sketches. “Once an early concept starts to materialize in an artist’s head, the creative process starts to take off and gain momentum,” Samar said.

A sketch of Leon’s story.

I then used the illustration app Procreate on my tablet to create a rough 2D mockup. This stage of the artistic process focused on establishing the character’s costume, proportions, and other details. The final concept art was used as a clear reference to drive the rest of the team’s design decisions.

Rough animation of Leon made with Procreate.

Moving to 3D, the Elara Systems team utilized Autodesk Maya to build, rig and fully animate characters, as well as Adobe Substance 3D Painter and Autodesk 3ds Max to create various environments for the short film. .

“We found the animation point cache export option in the Omniverse Connector for Maya invaluable,” says Samar. “This ensures that what we see in Maya is preserved when brought into USD Composer. USD Composer utilizes real-time rendering to create high quality visuals. ”

Real-time rendering enabled by Omniverse was “very important because without Omniverse, there was zero chance of finishing and distributing this content near the target deadline,” said the technical artist. rice field.

Leon brought it to life in 3D using Adobe Substance 3D Painter, Autodesk Maya, and USD Composer.

“I’m also a big fan of the Reallusion to Omniverse workflow,” he added.

Connectors allow users to easily bring characters created using Reallusion iClone into Omniverse and help provide visually realistic skin shaders. USD Composer can also enable real-time performance sessions for your iClone characters when live-linked with your motion capture system.

“Omniverse offers many possibilities to help streamline the workflow of traditional 3D animation teams. The feature set for some people is constantly expanding,” Samar said. “What I am most convinced of is the speed of development of the platform. Continuous updates and new features are being added rapidly.”

join the creation

Creators and developers worldwide can download NVIDIA Omniverse for free, and enterprise teams can use the platform for their 3D projects.

Check out other “omnivore” artwork and submit your project to the gallery. Connect your workflows to the Omniverse with software from Adobe, Autodesk, Epic Games, Maxon, Reallusion, and more.

Follow NVIDIA Omniverse Instagram, Moderate, twitter and YouTube For additional resources and inspiration.Check out Omniverse forumand our Discord server and convulsions channel Chat with the community.





Source link

Leave a Reply

Your email address will not be published. Required fields are marked *