YouTube enables AI dubbing of videos with voice

AI Video & Visuals


You may have come across videos on YouTube that are almost impossible to understand without subtitles in another language. And no content creator has the resources needed to prepare subtitles in every language for everyone in the world. To that end, Google is adding AI-powered dubbing to its Aloud-powered video hosting platform.

According to The Verge, the announcement was originally made during VidCon. Aloud’s team itself came about through Internet search giant Area 120’s in-house incubator, so it makes sense that the company would tie them up to do this.

Youtube
[Photo: SAM-RIZ44/Pixabay]

As it exists today, Aloud first transcribes the video and allows YouTubers to edit the transcription as needed. Once that’s done, the service uses AI to translate and dub the video. Content creators decide if they are happy with the results before uploading. According to Aloud’s website, the available languages ​​are still fairly limited at the moment, with the list consisting of two versions: Indonesian, Hindi and Portuguese, and two versions in Spanish.

Beyond that, the report says YouTube is also “working to make translated audio tracks sound like their creators’ voices, making them more expressive and lip-syncing.” These are planned for 2024, so don’t expect them to happen anytime soon.

Languages ​​are limited, but this AI dubbing tool has nothing but good things to say. However, it’s unclear if YouTube will do this for the platform as a whole, or maintain the existing model of individual content creators requesting access to the tool directly from his Aloud. That said, we can expect AI to be smart enough to avoid the excessive localization problem that plagues both video games and online video series.

(Source: The Verge, Aloud)

follow me Instagram, Facebook, twitter again telegram For more updates and the latest news, visit here.





Source link

Leave a Reply

Your email address will not be published. Required fields are marked *