Microsoft recently introduced a new feature in its Edge browser called AI Copilot, which has the ability to generate text summaries of videos. This feature is designed to save users time by summarizing the text transcripts of videos, rather than the videos themselves. However, it is important to note that this feature is still fairly limited and only works on pre-processed videos or those with subtitles.
According to Mikhail Parakhin, Microsoft’s CEO of advertising and web services, the video must be pre-processed in order for the AI Copilot to work effectively. If the video has subtitles, the feature can fallback on them to generate the summary. However, if the video does not have subtitles and has not been pre-processed, the AI Copilot will not be able to generate a summary. This limitation raises questions about the functionality of the feature when it comes to publicly available videos, such as those on YouTube.
In addition to the Edge browser, the AI Copilot feature can also be found throughout Microsoft 365. It is capable of summarizing Teams video meetings and calls for customer service agents. However, similar to the Edge browser, the audio of these videos needs to be transcribed first by Microsoft in order for the AI Copilot to generate a summary. This integration demonstrates Microsoft’s effort to streamline and enhance productivity for its users.
Designer Pietro Schirano shared a screen recording of the AI Copilot in action, as it summarized a YouTube video about the GTA VI trailer. In this case, the Copilot appeared to be functioning perfectly. With a simple click of the “Generate video summary” button, the AI Copilot quickly generated a summary complete with highlights and timestamps. It is worth noting that platforms like YouTube and Vimeo already offer automatic transcription and subtitle generation, but only if users enable the feature.
Microsoft’s AI Copilot is just one example of the company’s efforts to compete in the generative AI space, where Google and other tech giants are also vying for dominance. Last month, Google upgraded the YouTube extension for its Bard chatbot, enabling it to summarize video content and extract specific information from it. However, it is important to acknowledge that both Microsoft and Google’s generative AI features have their limitations and may not always provide accurate or comprehensive summaries.
Mikhail Parakhin has been open about the various stages of Copilot’s development on social media. The feature’s functionality has evolved over time, and Microsoft continues to work on improving its capabilities. It is crucial for users to be aware of the limitations of the AI Copilot feature and to manage their expectations accordingly.
While the addition of the AI Copilot feature to Microsoft Edge is a step towards enhancing productivity, it is essential to recognize its limitations. The feature relies on pre-processed videos or those with subtitles, and the audio needs to be transcribed before a summary can be generated. Microsoft’s integration of this feature throughout its suite of products demonstrates its commitment to improving user experience. However, competition in the generative AI space is fierce, and both Microsoft and Google’s offerings have their own drawbacks. Users should approach these features with an understanding of their limitations and a willingness to adapt as the technology continues to evolve.
Leave a Reply