YouTube integrates AI-powered dubbing tools

Image credit: Olly Curtis/Future/Getty Images

YouTube is currently testing a new tool that uses AI to help creators automatically dub their videos into other languages, the company announced at VidCon on Thursday. YouTube has partnered with AI-powered dubbing service Aloud, part of Area 120, Google’s internal incubator.

Earlier this year, YouTube introduced support for multilingual audio tracks. This allows creators to add dubbing to new and existing videos to reach a wider global audience. The company told TechCrunch that as of June 2023, creators will have dubbed over 10,000 videos in over 70 languages.

Previously, creators had to partner directly with a third-party dubbing provider to create their audio tracks, which can be a time-consuming and expensive process. Aloud allows you to dub your videos at no extra charge.

Google will introduce Aloud for the first time in 2022. AI-powered dubbing products transcribe, translate, and dub videos on behalf of creators. Creators can review and edit the transcription before Aloud generates the dubbing.

YouTube is testing the tool with hundreds of creators, Amjad Hanif, VP of YouTube Creator Products, told an audience yesterday. The company plans to open the tool to all creators soon. Aloud is currently available in English, Spanish and Portuguese. However, in the future, we plan to offer more languages, such as Hindi and Indonesian.

Hanif added that YouTube is “working on adding more expressions and lip-syncing to make the translated audio tracks sound like the creator’s voice.” YouTube confirmed to TechCrunch that in the future, generative AI will allow Aloud to activate features such as audio preservation, better emotional communication, and lip revival.