Meta also allows you to enable audio translation for content and proceed with AI translation tools to line up with audio translations.
As you can see in this example, Facebook users can now use the evolving audio translation elements of Meta AI to display certain content in different spoken language, making it seem like the people in the video are speaking in a different dialect.
As explained by Meta:
“Meta AI Translation uses the sounds and tones of your own voice and feels authentic. Also, the lip sync function matches the mouth movements in the translated audio, making it seem like you're actually speaking the language on the reel. ”
Meta has been developing this for a while, and the latest advances in AI recreation have allowed for a wide range of options that begin with an automatic translation from English to Spanish (and vice versa).
Creators can use the new toggle to choose whether or not they want to activate audio translations within Reels Composer. “We will translate your voice with Meta AI.”
As you can see in this example, you can also translate only the audio of the clip by simply turning on automatic lip sync or leaving the presentation alone.
“If you want to check translations before they are published, you can choose toggle to enable this option. You will then receive a notification (or you can access the Professional Dashboard) to review and approve translations. Accepting or denying translations will not affect the original untranslated reel.”
The translated reels will be presented to the viewer in their preferred language and will be notified that the reel has been translated with Meta AI. Viewers can also control whether or not they see the translation in a particular language.
Translating realistic translations of content into other languages could be a useful tool that allows you to expand your audience. Also, only Spanish will be available at launch, but Meta says it will add more languages to its options in the near future.
Like all automatic translation options, mistakes occur and the meta has some advice notes to help the system read the lips.
- The system supports translation of up to two speakers, but creators should not talk to each other to improve accuracy
- Creators should consider minimizing background noise and music on translated reels
- According to Meta, building a new audience in a new language takes time to gain traction in this segment, such as starting again.
So there are limitations to translating audio, not perfect. But by allowing new audiences to tailor your work, it helps you reach more people.
In addition to this, Meta also offers options to add to Facebook Page Manager Up to 20 unique dubbed audio tracks into one reel.
“Like meta AI translations, viewers listen to reels in their own language, allowing them to continue to build deeper connections with diverse audiences without language barriers.”
These manual tracks do not lip sync the same way, but offer another way to connect in other languages.
Facebook creators who have turned on Pro mode and have over 1,000 followers will now have access to features in the latest version of the app, and Instagram creators with local public accounts where Meta AI is available can also activate the option.
Learn more about Meta's latest AI translation features here.
