Meta announced on Tuesday the global rollout of an AI-powered voice translation feature for all Facebook and Instagram users. This new tool, available in regions where Meta AI operates, enables creators to translate their content into different languages, thereby reaching a wider audience.
First introduced at Meta’s Connect developer conference last year, this feature includes an initial pilot for automatically translating creators’ voices in reels on both Facebook and Instagram. The AI translations are designed to preserve the creator’s own voice’s sound and tone for authenticity when dubbing content into another language.
Moreover, creators have the option to utilize a lip-sync feature to better align translations with their lip movements, enhancing the natural appearance of the translated content.
At launch, the feature allows translations between English and Spanish, with plans to incorporate additional languages in the future. These AI translations are accessible to Facebook creators with at least 1,000 followers and all public Instagram accounts worldwide where Meta AI is available.
Creators can activate the option by clicking “Translate your voice with Meta AI” before publishing their reel. They can then toggle the button to enable translations and decide whether to add lip-syncing. Once they select “Share now,” the translation is applied automatically.
Creators have the opportunity to review translations and lip-syncs before making them public and can turn off either feature at any time. Opting out of the translation won’t affect the original reel, as noted by the company. Viewers will see a notification at the bottom of translated reels indicating that it was translated with Meta AI. Those wishing to avoid translated reels in certain languages can adjust their preferences in the settings menu.
Creators are also gaining a new metric in their Insights panel, allowing them to view their audience reach by language. This tool helps creators understand how translations are expanding their content to new audiences, which will become increasingly valuable as more languages are supported.
Meta advises creators to face forward, speak clearly, and avoid covering their mouth while recording for optimal results. Reducing background noise or music is also beneficial. The feature currently supports up to two speakers, who should avoid speaking simultaneously for accurate translation.
Additionally, Facebook creators can upload up to 20 of their own dubbed audio tracks to a reel, broadening their audience beyond English and Spanish-speaking markets. This option is available in the “Closed Captions and Translations” section of the Meta Business Suite and allows for adding translations both before and after publishing, unlike the AI-powered feature.
Meta has announced plans to support additional languages in the future but has not specified which languages will be included next or when they will be available.
In an Instagram post, Instagram head Adam Mosseri stated, “We believe there are many incredible creators with potential audiences who don’t necessarily speak the same language. By helping you reach these audiences across cultural and linguistic barriers, we can assist in growing your following and enhancing the value you get from Instagram and the platform.”
The introduction of this AI feature coincides with reports that Meta is restructuring its AI division to concentrate on four key areas: research, superintelligence, products, and infrastructure.
Read more tech updates here
