Meta currently offers AI-powered dubbing for video creators

Meta today announced a new AI-based translation tool for Instagram and Facebook creators. The company uses artificial intelligence to support lip sync and audio cloning, which promises to automatically duplicate videos in other languages and maintain the creator's tone and delivery. Here's how to use it:

Currently, the feature supports bidirectional translation between English and Spanish, with Meta saying “more languages will appear in the future.”

Creators can automatically dub the reels into other languages, allowing viewers to view the dubbed version in preferred languages, along with a subtle indicator that the video is being translated using Meta AI.

According to Meta, all Instagram users with public accounts and Facebook creators with over 1,000 followers are eligible to use the tool, and “except for countries where Meta AI is available (except for the UK, South Korea, Brazil, Australia, Nigeria, Turkey, South Africa, Nigeria, Texas and Illinois.”

How does this work?

For creators posting on Facebook, this is how to enable the feature.

Create a Facebook reel
Tap Translate your voice with Meta AI;
I'll turn it on Add lip sync Features (optional);
Tap I'll review it before publishing (option);
Tap Select a language Select the language you want to translate.
Tap the back chevron.
Tap Share now

According to Meta, you will be notified when the translation, dubbing and lip sync process is completed, so you can review, approve, remove lip sync, or remove translations entirely. You also have the option to report translation errors.

The company also says it will provide metrics to help creators understand performance by language so that they can track the language their audience is watching.