Meta releases AI voice translations to creators around the world

AI Video & Visuals


Meta has introduced new AI-powered voice translation capabilities to Facebook and Instagram Creators around the world. The company confirmed its global expansion on Tuesday.

This tool allows authors to convert content to other languages. Importantly, it retains the creator's own voice and tone, making the translation authentic.

This often feels separate from traditional dubbing. Meta has also added an optional lip sync function.

This will allow the translated audio to match the movement of your lips. As a result, the video looks more natural and attractive.

Meta AI TranslationMeta AI Translation
Image credits: Meta

language

At launch, this feature only supports translations between English and Spanish, with plans for additional languages ​​in the future.

However, the company did not specify which ones would arrive or when. This new feature is available to Facebook creators with at least 1,000 followers and all public Instagram accounts.

Easy to access

Creators can access features before publishing the reel. A new option, “Translating your voice into Meta AI” will be displayed to the editor.

Once selected, you can turn on translation and decide whether to include lip sync. You can also preview the reels before publishing.

And if the translations are not appropriate, you can turn them off. The original video remains the same.

Viewers also have controls and can choose to disable translation in Settings.

If the translation is active, a small notification at the bottom of the reel will notify viewers that Meta AI has generated dubbed audio.

AI voice translation xAI voice translation x
Image credits: Meta

New Metrics

Meta has added a new metric to the Insights panel. Creators can see the involvement of audiences by language.

This indicates the extent to which translated content reaches outside the major community of creators.

For example, English-speaking creators may discover that much of their opinions comes from Spanish-speaking audiences.

This knowledge allows them to coordinate their strategies and reach more people worldwide.

Best Practices

Meta recommends that creators follow certain guidelines for accurate translation.

  • Head directly to the camera.
  • Speak clearly and don't cover your mouth.
  • Minimize background noise and music.
  • Limit the reel to two speakers without overlapping dialogs.

Additional options

Facebook creators have another feature that allows you to upload up to 20 unique audio tracks.

This option appears in the MetaBusiness Suite under Closed Captions and Translations.

Unlike AI tools, this feature allows authors to manually add translations before or after publication.

This gives more control by creators who want to use their own recorded translations.

Global Reach

Meta says this feature helps creators connect with their audience across cultures and languages. Instagram head Adam Mosseri highlighted this point in a statement.

He said:

And if you can help you to speak other languages ​​and reach an audience that reaches beyond cultural and linguistic barriers, we can help you grow your followers and get more value from Instagram and the platform. ”

Read again: Meta will rebuild its AI division again



Source link

Leave a Reply

Your email address will not be published. Required fields are marked *