YouTube could soon use AI to automatically dub videos

YouTube revealed at VidCon this week that it is introducing a new AI-powered tool that will automatically dub movies into different languages ​​to help creators and viewers overcome language barriers. .

New Delhi: YouTube launches an AI-powered tool that allows artists to automatically dub their videos into different languages. For this project, the streaming site worked with the dubbing service. Aloud is currently available in English, Spanish, and Portuguese, with plans to add more languages ​​in the future.

advertisement

advertisement

YouTube’s new AI-powered tools

YouTube revealed at VidCon this week that it is introducing a new AI-powered tool that will automatically dub movies into different languages ​​to help creators and viewers overcome language barriers. . The feature has been in development for years as part of Google’s Area 120 experimental project incubator, but it was revealed last year as part of Google’s push for AI-driven capabilities across all of its goods and services, according to 2018. According to a 2018 report, XDA Developers.

Mechanism of dubbing tool using AI

Google hopes the tool will make dubbing more accessible to creators who find it too difficult or too expensive to dub their videos into multiple languages. For those wondering how it all works, Aloud’s official website states that the program first transcribes the video and then allows the author to evaluate and correct the transcription. I’m here. It will then be translated and dubbed into the target language before being uploaded by the developer, the report said.

YouTube statement on AI-powered dubbing tools

According to YouTube’s Amjad Hanif, the technology is currently being tested with hundreds of creators around the world. He added that, according to a statement sent to The Verge, it currently supports only a handful of languages, but plans to add more in the future.

The company previously said in a statement that it outlined the challenges it faces. “Subtitles can help bridge language gaps, but due to their small form factor, the constant need to pay attention to the screen, and accessibility issues for people with visual or reading disabilities, they are not available on mobile devices. It’s not always ideal: adding dubbed, process-translated audio tracks can overcome these limitations, but it’s time-consuming and cost-prohibitive for most creators.” said in a statement quoted by Niowin.

What is Google’s Aloud?

Aloud is an AI-based tool that helps authors reach more readers. According to Hanif, XDA developers report that the company not only aims to make the translated audio tracks sound like the creators’ voices, but also aims to inject more expression into the dubbed content. It is said that there is