At VidCon this week, YouTube announced it will be integrating a new AI-powered tool that will automatically dub videos into other languages to help creators and viewers overcome language barriers. The feature has been in development for years as part of Google’s Area 120 incubator for experimental projects, and was announced last year as part of an AI-driven enhancement to all of the company’s products and services.
Called ‘Aloud’, this new tool allows creators to: “By dubbing videos into multiple languages quickly and easily, you can unlock knowledge that might be trapped in a single language today.” Google hopes the feature will make dubbing more accessible to creators who find it too complicated or too expensive to dub their videos into multiple languages. For those wondering how it all works, Aloud’s official website states that the tool transcribes the video first, allowing creators to review and edit the transcription. It has been. The creator then translates and dubbs the video into the target language before publishing.
in a statement to The VergeYouTube’s Amjad Hanif said the feature is currently being tested with hundreds of creators around the world. He added that it currently supports only a handful of languages, but that more will be added in the future. The company previously announced that Aloud will only be available in English, Spanish and Portuguese at launch, with Hindi, Indonesian and other languages to be added to the list in the near future.
Aloud is a really cool use of AI and should help creators reach a wider audience. Hanif said the company is working not only to make the translated audio tracks sound like the creators’ voices, but also to incorporate more expression into the dubbed content. In addition, we are looking into adding lip-syncing to make the video look more natural. However, these features are only coming next year, so for now the video remains out of sync with the audio and the dubbed voice sounds relatively mechanical.
