Meta Expands AI Translation Tool for Instagram and Facebook Reels with Voice and Lip-Sync Features
By
Emma Roth
Solid neighbourhood-bakery energy. Trustworthy and warm.
Summary
Meta is expanding its AI-powered translation tool to Facebook and Instagram users, allowing automatic dubbing of reels into different languages. The feature uses AI to match the translated audio with the speaker's voice characteristics and lip movements. Currently available for English-Spanish translation (and vice versa), users can enable the tool through a toggle before publishing reels. The technology was previously previewed at Meta's Connect event last year.
Key quotes
· 4 pulledMeta is bringing its AI translation tool to more users on Facebook and Instagram, which automatically dubs your reels into another language
The feature also uses AI to make its dub match up with the sound of your voice and the movement of your mouth
You can enable the tool by selecting the Translate voices with Meta AI toggle on the menu that appears before you publish a reel
You can even have Meta AI match the movement of your lips to the translated audio
You might also wanna read
Meta launches paid subscriptions for Instagram, Facebook, and WhatsApp globally, tests AI and creator plans
Meta is rolling out paid subscription plans for Instagram, Facebook, and WhatsApp globally, priced between $2.99 and $3.99 per month, offeri
techcrunch.com·5h ago
Meta launches paid add-ons for Instagram, Facebook, and WhatsApp alongside AI subscription tiers
Meta is launching paid subscription add-ons for Instagram, Facebook, and WhatsApp globally, alongside a separate paid AI offering. The basic
the-decoder.com·2d ago
Meta Launches Omnilingual ASR Supporting Over 1,600 Languages
Meta introduces Omnilingual Automatic Speech Recognition (ASR), a suite of models that provides speech recognition capabilities for over 1,6
ai.meta.com·6mo ago
Meta tests AI subscription services in bid to diversify beyond advertising revenue
Meta is testing AI-powered subscription services for its Meta AI app and website, marking another attempt to diversify revenue beyond its co
cnb.cx·1d ago
VIDEO AI ME on Product Hunt: AI video creation platform with realistic actors and 70+ language support
This article promotes VIDEO AI ME, a platform on Product Hunt that allows users to create AI-generated videos with realistic actors. Users c
Product Hunt·1mo ago
BlipCut AI Video Translator: Multilingual Video Localization Platform
BlipCut is an AI-powered video localization platform designed to help creators, educators, and businesses reach global audiences. It offers
Product Hunt·9mo ago