YouTube has introduced a new tool that allows video creators to automatically translate their videos into different languages. This tool uses AI, which stands for artificial intelligence, to do the translation. TechCrunch reports that the announcement was made by YouTube at a conference called VidCon. YouTube has partnered with a company called Aloud, which also uses AI to dub videos. Aloud is part of Google’s internal incubator called Area 120.
Earlier this year, YouTube added the ability for creators to create multiple audio tracks in different languages. This means that creators can add voiceovers to their videos so that people who speak other languages can understand them. By June 2023, the creator has already dubbed her over 10,000 videos in over 70 languages.
Prior to this new tool, creators had to work with other companies to provide dubbing services. This can be very time consuming and expensive. But with Aloud, creators will be able to dub their videos for free.
Aloud was created by Google in 2022. Use AI to transcribe, translate, and dub your videos. Creators can review and edit the transcription before Aloud dubbs it.
YouTube is currently testing the tool with hundreds of creators. Amjad Hanif, VP of YouTube Creator Products, mentioned this to the audience at the conference. Hanif also said YouTube will soon make the tool available to all creators. Aloud is currently only available in English, Spanish and Portuguese. But in the future, more languages will come, such as Hindi and Indonesian.
Hanif also noted that YouTube is working to make the translated audio tracks sound like the creators’ voices. They want the dubbed version to have the same facial expressions and lip movements as the original. YouTube confirmed to TechCrunch that it plans to add more features to Aloud using generative AI, including preserving creators’ voices, improving emotional transmission and reviving lip movements.
