What I’m looking forward to: Fast real-time translation is one of the key selling points that tech giants have been leveraging to drive generative AI, and Microsoft plans to build it into its Edge browser soon. YouTube has been developing translation services for some time, but Microsoft aims to extend AI video translation to many other sites and services.
Microsoft this week announced an AI-based video translation feature coming soon to Edge. This feature automatically generates foreign language transcriptions and dubbing for videos on a growing list of sites, including YouTube, LinkedIn (owned by Microsoft), Bloomberg, Reuters, and Coursera.
Microsoft posted a short clip demonstrating the feature. This video shows an Edge user clicking the translate icon near the top of his LinkedIn video of his Microsoft Ignite keynote speech by CEO Satya Nadella. A menu will appear with options for translating audio or subtitles from English to other languages.
After selecting English and Spanish as the input and output languages from the drop-down menus, the user[翻訳]Click. The video pauses and the original audio is replaced with the Spanish dub.
When this feature debuts, Edge will support Spanish to English translations, and English to Spanish, Italian, Russian, and Hindi translations. Perhaps other languages will follow suit. Additionally, real-time interpretation for news sites such as Reuters, CNBC, and Bloomberg is also planned.
Edge's translation feature proposes a feature that YouTube has been testing for years across the entire browser. Independent YouTubers and companies have been streaming human-translated and dubbed videos on the site for some time, but YouTube announced last year that it would officially support the trend. YouTubers have been able to upload videos with multiple audio tracks since last year, and a small startup industry is helping some of the most popular content creators dub their videos into numerous languages. are doing.
Some of these translations use AI tools, but are combined with human writing to ensure accuracy. Because Microsoft's solution supports any video on multiple sites, it could potentially be fully automated, raising concerns about reliability. Google Translate's accuracy is known to vary widely by language, and generative AI has yet to solve the hallucination problem.
AI-generated summaries are also appearing on YouTube from both Google and Microsoft. Last year, YouTube began experimenting with video summaries to supplement official descriptions, and now Edge can use AI to summarize official video transcripts.
