Microsoft Edge Introduces real-time AI Translation for YouTube and More

Microsoft Edge will deliver real-time translation and dubbing for videos on platforms such as YouTube, LinkedIn, and Coursera, among others. This new AI-powered function, announced at the 2024 Build event, will translate spoken content in real time, including dubbing and subtitles; one can leverage this AI skills to translate videos from one language to another.

The feature currently supports Spanish-to-English translations as well as English-to-German, Hindi, Italian, Russian, and Spanish.Additionally, this feature can also provide subtitles to those who are hard of hearing.

The Redmond-based tech company announced that the Edge browser will include the aforementioned real-time video translating capability.

This new function intends to improve accessibility, especially for users who are deaf or hard of hearing, by making video content easier to understand. Edge will also provide real-time translation for videos on news sites such as Reuters, CNBC, and Bloomberg, with plans to extend the number of languages and supported websites in the future.

This functionality adds to the range of AI technologies Microsoft has integrated into Edge via Copilot, which already includes the ability to summarize YouTube videos. However, the current summarizing feature is constrained by its reliance on the availability of video transcripts. 

Microsoft claims that the movie is completely translated on the device, with no data leaving the system. The corporation has stated that no part of the video or audio content ever leaves the machine or is processed in the cloud. In terms of translation quality,

Furthermore, Microsoft stated that various aspects influence how accurate the translation is, including background music, number of speakers, source language, and so on. "We are constantly striving to enhance the quality of translation. However, the business warned that AI-generated content may contain inaccuracies," the company added.