Multilingual narration dubbing tool powered by YouTube’s new AI
YouTube has some big announcements for creators at this year’s VidCon. One of our newest features is an AI-powered multilingual narration dubbing tool for video content. The tool is powered by AI dubbing company Aloud, part of Google’s own Area 120 startup incubator.
How does the tool work?
Aloud first provides the creator with the transcription of the video. The user can edit the transcribed text as desired. Once the creator signs off on the transcription, Aloud creates her AI dubbing of the video. Aloud currently offers this service for free on its website, separate from the tools YouTube has built into its platform, but there is currently a waiting list.
Tool limitations
According to the website’s FAQ section, Aloud has some pretty big limitations. The startup’s AI-powered tool currently only works with English-language videos, and can only dub his two languages, Spanish and Portuguese, at the moment. But with Google’s backing and a new partnership with YouTube, it shouldn’t be surprising that Aloud will roll out even more language options in the near future.
Tool test
A YouTube spokesperson told The Verge that the company is already testing its AI dubbing tool with “hundreds” of creators.
Benefits for creators
The tool is the second major feature related to multilingual dubbing that YouTube launched this year. The company unveiled in February the option for him to upload multiple audio tracks for individual videos, sorted by language.Viewers will be able to enable this feature for YouTube videos[設定]You can now choose to listen to an alternate audio track in your language of choice with the touch of a button. However, this feature requires the creator to provide their own voice, which requires the YouTuber to translate and dub the video themselves. A partnership between YouTube and Aloud to create AI-powered dubbing could help YouTubers save both time and money while expanding their audience.
Conclusion
YouTube’s AI-powered multilingual narration dubbing tool is a game changer for creators looking to reach a wider audience. With the help of Aloud, YouTube makes it easy for creators to dub their videos into different languages without spending a lot of time and money on translation and dubbing services. The tool has some limitations at the moment, but in the near future Aloud may expand to more language options and become an even more valuable resource for creators.
